Details
Details

Running test scenarios via setcom automation functionality

setcom Automation Solution T-Script

For the S-CAT 6010 Functional Test System, setcom is introducing an automation interface.  This interface allows the user to define easy and clear test scenarios by a “drag and drop” approach, instead of a complex programming environment.  This method provides a fast, easy and low cost way to create automated test scenarios  within a short duration.

S-CAT 6010 Graphical User Interface (GUI)  for Automation :

Using the S-CAT GUI interface, is a very simple and user friendly task to complete.  The user  only needs to drag commands from the command library (right part of the screen, shot above) and drop them into the scripting window (left part of the screen, shot above) and then execute the customer defined test scenario.  The activity window (bottom part of the screen shot above) provides the current status of the execution and other useful information that appear during the run.

The Command Library consists of the following groups of commands:

  • S-CAT 6010 Commands, allow the control of the system simulator
  • Automation Commands, allow control of external devices
  • Script Commands allow to perform simple programming possibilities like LOOP, IF, ELSE etc

Most functionalities, right from setting up the system parameters, test initialization and stopping the system are available.  Not only the basic scenarios, but also complex cases which involves different applications can be created and tested with help of client or server states.

The  automation interface is an integral part of the remote GUI of the S-CAT 6010 test system.  Remote GUI means that the test system is controlled via an Ethernet interface and the GUI is running on the personal laptop of the test engineer.  Starting the automation server is automatically done via the GUI and then User can start creating scenarios or select a existing one and execute them.

Example of a basic automated script:

A loop sending an SMS 30 times from the S-CAT 6010

The user can see, from the above example, that commands, such as setting the system parameters, session parameters and starting the server, are straight forward.  The script is written based on server and client states (they are called events in command library).  Once the client is attached to the system (wait for GERAN_STANDBY or GERAN_IDLE) an SMS is sent to the client.  This task will be performed until the loop is completed, after which the client returns to initial state (idle or standby). Automation scripts can be written to perform various tests during application development cycle.  The nature of these tests can be:

  • Functional Testing
  • Performance Testing
  • Boundary Testing
  • Regression testing.

 

Example of Regression Testing:

These tests at system level are performed to make sure that bug fixes do not cause malfunction of already implemented features.  Various scenarios can be easily created and executed without large manual intervention.  It is possible to create scenarios involving multiple applications (e.g. MMS during a call, DM session during a call, Call during streaming etc.).  A good example of a basic regression test scenario would be a case where the system simulator, in continued loop, would perform:

  • initializing a call with the terminal
  • use several features of the terminal (e.g. sent SMS, or even perform handover)
  • Clear the call
  • Return to the starting point

The above steps will run in an indefinite loop.  Test engineers could leave the system up and running over night, or even over the weekend, to see if the terminal is still functional after a long time has elapsed.

The interface is preloaded with examples consisting of modules with which any user with a basic programming knowledge, can  easily create test scenarios to perform automation testing.  The setcom team provides continuous support and guidance until the user has complete understanding of the interface.

In summary, setcom has designed a very easy interface.  The scripting commands used in the API follow similar syntax to most common programming languages like C.  setcom also provides clear and precise documentation explaining the commands and their usage.