Skip to main content
Samsung Developer Program

Android App Beta Testing

Either before or after normal release to the public, you can beta test your Android apps (open or closed beta test) and their in-app items (closed beta test only), in order to obtain feedback from beta testers and improve their quality. Open and closed beta release does not require validation testing of the beta version app or its in-app items.

Note: You can test your Android apps on a target device before submitting it for validation. Remotely access a Samsung mobile device over the Internet using the Cloud Device Farm or Remote Test Lab.

Key differences:

  • Open beta testing
    • Anyone who follows the beta download URL can be a beta tester and download beta apps for free.
       
  • Closed beta testing
    • Up to 1000 users with Samsung accounts who are registered can be beta testers and download beta apps for free.
    • Up to 400 registered beta testers can get in-app items for free.
       

You can release apps under the following normal and beta release scenarios:

  • Beta test release during initial app registration, followed by a normal release
    • Follow this section.
       
  • Normal release without a beta release
  • Normal release after initial app registration, followed by a beta release, followed by an update release
    • During initial app registration:
    • After the app is being normally distributed:
      • Create a beta release app version.
      • Follow this section to:
        • Release the beta version app under beta release conditions.
        • Use the beta test results to change the app (and its in-app items) as necessary.
        • Update the original version and its in-app items (Update Your App). 
           

For more details about beta testing scenarios, operations, requirements, and conditions, see Android and Galaxy Watch App Beta Testing Overview.

Manage Android Beta Testing

You register beta release information either before or after normal release, complete the registration or update of the beta release app (open and closed beta) and its in-app items (closed beta only), initiate beta release, support the beta testing (including responding to beta testers), and then either allow the beta release to stop as scheduled or manually stop it.

To set up a beta test

  • When you are at the partner level or above, you must submit a request (Seller Office > Support > Contact us) before setting up a beta test.
  • Beta releases can only occur either before the app has been submitted for validation testing ('Registering' status') or after the app is being distributed ('For Sale' status).
  • The registration must be complete for your beta version app and its in-app items (when offered and tested). For details, see How to Register Your Android App.
  • Your beta app distribution devices and countries must include your beta testers' devices and countries.
  • For closed beta tests, determine who can be a beta tester and get their Samsung account name / email address.
  • Caution: You can register and conduct only one beta test at a time. If you register a second beta test, the first will be suspended and terminated.
     
  1. In Seller Office, click Applications > My Applications.
    1. Navigate to your app.
      BetaTest_Registering_Update.png
      BetaTest_Updating.png
       
    2. When beta testing during initial registration before validation testing, click your app's 'Registering' status link.
    3. When beta testing after normal distribution:
      1. To initiate registration of a beta release, click your app's Update.
      2. To continue registering a beta release after saving initial beta registration info, click your app's 'Updating' status link.
         
  2. In your Android app page:
    1. Click the Binary tab.
      BetaTest_Registering_Android.png
       
  3. For open beta tests, set up the beta test:
    1. In the Binary tab, click [Open Beta Test] Settings.
      BetaTest_Registering_Open_Android.png
      Note: The Beta Testing (download) URL is complete after the beta app binary files are registered.
       
    2. In the Beta Test fields, enter the open beta test information.
    3. Click Save.
       
  4. For closed beta tests, set up the beta test:
    1. Specify the testers and your feedback channel:
      1. In the Binary tab, click [Closed Beta Test] Settings.
        BetaTest_ClosedBetaSetup.png
        Note: The Beta Testing (download) URL is complete after the app binary files are registered.
         
      2. In the Beta Test section, enter the closed beta test information.
      3. Click Save.
         
    2. To offer all in-app items for free to one or more beta testers:
      Note: In-app item purchase transactions cannot be tested by these beta testers because actual billing will not occur for them.
      1. Click Profile.
      2. Enter your Seller Office password and click Confirm.
      3. At the bottom of the page, click Edit.
      4. Enter your Seller Office password again and click Confirm
      5. In the Edit Profile page:
        BetaTest_LicenseTestFreeTesters.png
         
        1. In the License Test section, enter the Beta testers for free in-app items information.
        2. In the password field of the Basic Information section, enter your Seller Office password.
        3. Click Save.
        4. Enter your Seller Office password and click Confirm.
           
  5. For both open and closed beta tests, set the beta release dates:
    1. Click the Country & Price tab.

    2. Click Mode Advanced.
      Selling_StartsEnds.png

    3. Enter the beta test start and end dates.

    4. Click Save.
       

To release a beta app

  • Beta releases can only occur either before the app has been submitted for validation testing ('Registering' status') or after the app is being distributed ('For Sale' status).
  • For open and closed beta tests, beta testing must be set up.
  • For open beta tests, determine who can be a beta tester and get their email addresses.
  • Coordinate with your beta testers.
    You can direct them to the Beta Tester Guide webpage.
     
  1. In Seller Office, click Applications > My Applications.
    1. Navigate to your app.
      BetaTest_Registering_Update.png
       
    2. When beta testing during initial registration before validation testing:
      1. Click the app's 'Registering' status link.
      2. Complete the registration (including all required fields) of the beta release version app and its in-app items (when offered and beta tested).
        For details, see How to Register Your Android App.
         
    3. When beta testing after normal distribution:
      1. Click the app's 'Update' status link.
      2. Complete the registration (including all required fields) of the beta release version app, and its in-app items (when offered and beta tested).
        For details, see How to Register Your Android App.
        Caution: Two versions of your app will be distributed (original version under normal distribution, and a beta version under beta release distribution). When offering and testing in-app items, both versions must support the same items. There are other requirements and restrictions. For details, see Android and Galaxy Watch App Beta Testing Overview.
         
  2. In your Android app page:
    BetaTest_Submit.png
    1. Verify the 'Submit Beta Test' button has a teal background.
      If not, one or more required field entries for your app and/or in-app item registration do not meet minimum requirements.
    2. Click Submit Beta Test.
      Your app and its in-app items will be beta released on the start date (when specified) or within 10 minutes of submission.
    3. Click Applications > My Applications.
    4. Navigate to your beta version app.
      BetaTest_BetaDeployed.png
       
    5. Verify that your beta release app is listed, its title has a '[Beta]' prefix, and its status is 'Beta Deployed'.
       

To suspend and terminate a beta release 

Note: Beta releases automatically stop on the specified end date and beta testers can continue to use in-app items they got before the beta release stopped.

Caution: After suspending or terminating a beta release, you cannot restore the beta release. However, you can register and submit the same beta test again.
 

  1. In Seller Office, click Applications > My Applications.
  2. Navigate to your 'Beta Deployed' app.
    BetaTest_BetaDeployedandSuspend.png
     
  3. Click Suspend.
    BetaTest_BetaSuspended.png
     
  4. Verify your beta app's status is 'Beta Suspended'.
    Within 10 minutes, the beta version app can no longer be downloaded.
     
  5. For beta apps with in-app items:
    1. Beta testers can continue to use in-app items they got before the beta release stopped.
    2. To stop beta testers from using in-app items they got before the beta release stopped:
      1. Click your beta app's IAP Active.
      2. In the IAP Activation Change popup, select Inactive and click OK.
         
    3. To reenable beta testers to use in-app items they got before the beta release stopped:
      1. Click your beta app's IAP Inactive.
      2. In the IAP Activation Change popup, select Active and click OK.
         
  6. To permanently stop changing a beta release and remove it from the My Applications page, click Terminate.
    Beta testers cannot use in-app items they got before the beta release stopped.
     

After Beta Testing

After beta release testing, you can: 

  • As necessary, change your app and in-app items.
  • For beta testing during initial registration, complete the registration of your app and in-app items (How to Register Your Android App).
  • For beta testing after normal distribution of the original version app:
    • As necessary, change the registration of in-app items (Add In-App Items).
    • Register changed app information and binary files as a new update (Update Your App).
       
  • Prepare for Validation.
  • Submit the changed app and in-app items for validation testing (App Validation through Seller Office).
  • After they pass validation testing:
    • After beta testing during initial registration:
      • Your changed app is normally distributed as specified.
      • The offering and sale of its in-app items are supported.
         
    • After beta testing after normal distribution:
      • Your original version app distribution is stopped.
      • Your changed app is normally distributed as specified.
      • The offering and sale of registered in-app items are supported.
         
    • For more details, see App and Financial Management through Seller Office.

 

  • Was this article helpful?