WHDL - 00011065

Interacting With a User Interface Using Robotics: a C# Library and Python Based Server

Timothy Scott Mong

Description / Abstract

Submitted to the Department of Mathematics and Computer Science in partial fulfillment of the requirements for the degree of Bachelor of Arts

In the Reliable Deployment Lab at HP (RDL), automation is a vital aspect of testing. Currently, web requests perform all the automation, but there is no mechanism for automated physical interaction. Since humans do not typically interact with a device via web-requests, RDL assigned the developer a prototype project that manipulates a device screen physically. At the beginning of the project, the robotics package could move and press a stylus in a coordinate system native to the robot. The developer created a C# library that sends Move and Push requests to the robot via HTTP. The library also converts user interface coordinates into the native robot coordinates. To test the library and provide demonstration capabilities, the developer also created a test harness and WinForms demo utility. The robot hosts an HTTP server and listens for HTTP POST requests that solicit interactions in a network environment. The developer also created the Modular Architecture Robot Server (MARS) for selecting and mounting additional python modules on the robot for exposure as a resource. The robot can perform standard workflows but requires human aid for coordinate discovery. The project was a success but likely will not be implemented as a testing standard.

Interacting With a User Interface Using Robotics: a C# Library and Python Based Server

Description / Abstract

Download this Resource

Download Free from WHDL

Collections With This Resource

NNU Computer Science Theses

Related Resources

3THIRTYTHREE 1998-1999

3THIRTYTHREE 1999-2000

A History of the Town and College of Bethany, Oklahoma

A Mobile Application for John Wesley's Explanatory Notes on the Bible

A Mobile Application for Northwest Nazarene University’s Complex College Community

A Modification to Meal Ticket’s Global Trade Item Number Validation to Use GS1 Data

A Novel Tool for the Identification of Plasmid Backbone Gene Labels

Addressing Data Integrity for Individual Profiles and Building Data Flow Models at NNU

An Anatomical and Physiological Study on the Effects of Whiplash

An Exegetical Study of Peter's Understanding on Christian Suffering in 1 Peter 4:12-19

Analysis of Spectral Reflectance and Separability of Vegetation for FireMAP

Anamnesis

Android Application for Completing Medical Forms

Android fruit harvest helper apple detection app development with React Native

Application of Robotic Turf Mowing

Assisting Frog Identification in Costa Rica Using a Mobile App

Autism Spectrum Disorder: Unique Challenges and Specific Demands

Autonomous Drone Project

Basketball Workout Application

Bethany Nazarene College Yearbooks

Big Data for Savings Groups: A Study and Application of Data Visualization

Classification of Aerial Imagery using a Relational Convolutional Neural Network

Classifying Wildland Fire Severity on Landsat Imagery Using Machine Learning Trained by Hyperspatial Imagery

Cloud Based Plasmid Annotation Tool

Counseling Department Scheduling and Accreditation Tool

About the Authors

Timothy Scott Mong