Skip to main content
Samsung Developer Program

Android and Gear Beta Testing Overview

Either for the first release of your app or after one or more normal releases, you can beta test versions of your Android apps (with or without in-app items), Gear apps and Gear watch face apps (with or without in-app items), in order to get feedback from beta testers and improve product quality.

 

Beta release does not require validation testing of the beta version app or its in-app items (when offered). Normal release requires the app and its in-app items to undergo and pass validation testing.

Depending on the type of beta version app, and whether or not it has in-app items, they can undergo two types of beta testing:

  • Open beta test (Android apps without in-app items) performed by any number of beta testers who follow a beta test download URL that you send to them.
  • Closed beta test (Android apps, Gear apps, and Gear watch face apps) performed by up to 1000 beta testers who you register, and who follow a beta test download URL that you send to them.

Note: When you are at the partner level or above, submit a request before setting up a beta test (Seller Office > Support > Contact us).

Beta and Normal Release Scenarios

You can release your Android, Gear, and Gear watch face apps under the following scenarios:

  • Beta release during initial app registration, followed by a normal release:
    • Register the beta version app, and its in-app items (when offered and testable).
    • Set up the beta release.
    • Coordinate with your beta testers.
      You can direct them to the Beta Tester Guide webpage.
    • Submit the app (and its in-app items) for beta release distribution.
    • Conduct beta testing.
    • After beta testing:
      • Change the app (and its in-app items) as necessary in response to beta test results.
      • Register the changed app (and in-app items).
      • Submit the changed app (and in-app items) for validation testing.
      • After passing validation the changed app is normally distributed and its in-app items are supported (when offered).
         
  • Normal release without a beta release:
    • Register the normal release version of the app and its in-app items (when offered).
    • Submit them for validation testing.
    • After passing validation the app is normally distributed and its in-app items are supported (when offered).
       
  • Normal release, followed by a beta release, followed by an update normal release:
    • Register a normal release version of the app and its in-app items (when offered).
    • Submit them for validation testing and normal distribution.
    • During normal distribution:
      • Update the original version app with a beta version app, and beta in-app items (when offered and testable).
      • Set up the beta release.
      • Coordinate with your beta testers.
        You can direct them to the Beta Tester Guide webpage.
      • Submit the beta app and in-app items for beta release distribution.
         
    • During beta release:
      • Two app versions are distributed that share the same set of in-app items:
        • Original version app continues to be distributed normally and the registered in-app items are available to users.
        • Beta version:
          • Beta version app is distributed under the beta release operations, requirements, and conditions (see below).
          • When in-app items are offered and testable, they are available to beta testers.
          • Beta release stops as scheduled or by manual suspension.
             
    • After beta release:
      • Change the app (and its in-app items) as necessary in response to beta test results.
      • Update the original app version:
        • Register the changed app information and binary files.
        • Change the registered in-app items, as necessary.
      • Submit the updated app (and its in-app items) for validation testing.
      • After passing validation:
        • The changed app is normally distributed and its in-app items are supported (when offered).
        • The distribution of the original version app is stopped.
        • The original app is permanently deleted from Seller Office.

 

Beta Test Operations

After registering and submitting a beta app and its in-app items (when offered and testable) for beta release:

  • Samsung:
    • For open beta tests:
      • From the start date, Samsung enables anyone who accesses the download URL to download of the beta app for free. Note: Beta testers cannot test app purchase financial transactions.
      • On the end date, Samsung automatically:
        • Suspends the beta release (see below).
        • Sets IAP support to the IAP Active state (see below).
           
    • For closed beta tests:
      • From the start date, Samsung enables beta testers registered in the Beta Test fields of your app's Binary tab to download the beta app from the download URL for free.  Note: All closed beta testers must be registered here, and cannot test app purchase financial transactions.
      • When in-app items are offered:
        • Beta testers not registered in the License Tester setting field of your Profile page can only get all offered in-app items by actually being billed for them. Note: These beta testers can test in-app item financial transactions.
        • Beta testers registered in the License Tester setting field of your Profile page can only get all offered in-app items for free. Note: These beta testers cannot test in-app item financial transactions.
        • On the end date, Samsung automatically:
          • Suspends the beta release (see below).
          • Sets IAP support to the IAP Active state (see below).
             
  • You:
    • Before the beta release start date and by a method that is independent of the Samsung ecosystem, send each beta tester: the Beta Testing (download) URL, your beta Feedback Channel address, the beta release start and end dates, and any other information testers need to know about beta testing your app.
    • Can respond to beta tester comments they register in your beta app's product detail page in Galaxy Apps, or they provide to your Feedback Channel address.
    • Can manually suspend the beta release before the specified end date (see below).
       
  • After you suspend beta app download:
    • Initially, IAP support is set so all IAP method calls are processed as specified (IAP Active state).
    • During the IAP Active state, beta testers:
      • Cannot download the beta app.
      • Can use the beta app they downloaded before beta release suspension.
      • Can use in-app items they got before beta release suspension and during the IAP Active state.
      • Can review and get additional in-app items during the IAP Active state.
         
    • You can toggle IAP support between: the IAP Active state, and the IAP Inactive state (no IAP calls are processed).
    • During the IAP Inactive state, beta testers:
      • Can use the beta app they downloaded before beta release suspension.
      • Can use in-app items they got before beta release suspension and during the IAP Active state.
      • Cannot review and get additional in-app items.
         
    • You can terminate the beta release:
      • The beta app listing is permanently removed from the My Applications page and the beta release cannot be re-instated.
      • After termination, beta testers:
        • Cannot download the beta app.
        • Can use the beta app they downloaded before beta release suspension.
        • Can use in-app items they got before beta release suspension and during the IAP Active state.
        • Cannot review and get additional in-app items.
           

Beta Test Requirements and Conditions

The type of beta test affects: the release conditions of the beta app, whether beta apps with in-app items are testable, and affects related apps (original version app and host app). 

Open beta tests

  • Beta version apps:
    • Free and paid Android apps without in-app items are testable.
    • App purchase functionality is not testable. All beta testers download beta apps for free.
    • Android app distribution devices and countries must include your beta testers' devices and countries.
       
  • You:
    • Can beta test apps before they have been validated ('Registering' status) or after they are being distributed ('For Sale' status).
    • Provide the beta testers with the beta test download URL, your feedback channel address, the start / end dates, and any other information needed for the beta test.
    • During beta testing:
      • Do not update the original version app associated to the beta version app, and do not add, change, or delete any of its in-app items.
      • Respond to beta tester feedback that they provide in beta app product detail page in the Samsung app store, or to your beta testing feedback channel address.
      • Can stop beta testing distribution by suspending it.
         
  • Beta testers:
    • Must have Samsung Android phones with Galaxy Apps version 4.1.03-1 or higher.
    • Can only download the beta release app from the beta test download URL.
    • Download paid apps for free.
       

Closed beta tests

  • Beta version apps:
    • Free and paid Android apps without in-app items are testable.
    • Free and paid Android apps that integrate IAP version 4.0 or later with in-app items are testable.
      • One or more beta testers can test in-app item purchase functionality, which requires that they be billed for in-app items.
      • Up to 400 beta testers can get all in-app items for free, but cannot test in-app item purchase functionality.
        However, they can test all other IAP functionality (including reviewing available in-app items).
         
    • Free and paid Android apps that integrate IAP version before 4.0 with in-app items are testable except that no IAP method calls will be processed.
    • Free and paid, standalone and companion, Gear and Gear watch face apps without in-app items are testable.
    • Free and paid, standalone and companion, Gear and Gear watch face apps with in-app items are testable.
      • All Gear beta testers can test in-app item purchase functionality, which requires that they be billed for in-app items.
         
    • For all beta apps, app purchase functionality is not testable. All beta testers download beta apps for free.
    • For companion Gear beta apps, their host Android app must be in normal distribution ('For Sale' status).
    • For Android beta apps, their distribution devices and countries must include your beta testers' devices and countries.
    • For Gear beta apps, their distribution Android / Gear device combinations and countries must include your beta testers' Android / Gear device combinations and countries.
       
  • You:
    • Can beta test all supported apps, and their in-app items when supported, either: before they have been validated ('Registering' status) or after they are being normally distributed ('For Sale' status).
    • Register beta tester Samsung account name / email addresses:
      • Register up to 1,000 beta testers so they can download the beta version app (paid apps for free).
        Note: All beta testers must be registered here, and cannot test beta app purchase financial transactions.
         
      • For Android apps with in-app items, register up to 400 beta testers so they can get the in-app items for free. 
        Note: These beta testers cannot test in-app item financial transactions.
         
    • Before beta testing:
      • Make sure each beta tester: 
        • Has a distribution device for the beta app: a Samsung Android mobile device (to test both Android and Gear beta apps), a Samsung Gear device (to test Gear beta apps).
        • Is in a distribution country for the beta app.
           
      • Provide each beta tester with the beta testing download URL, your feedback channel address, the beta app download start / end dates, whether or not the tester can get in-app items for free, whether or not and when testers can get in-app items after beta app download is suspended, and any other information needed for the beta test (for example, particularly important app features to test, test scenarios, and test limitations).
         
    • During beta testing:
      • Do not update the original version app associated to the beta version app, and do not add, change, or delete any of its in-app items.
      • For companion Gear app beta tests, do not update the host Android app or any of its in-app items.
      • Respond to beta tester feedback that they provide in beta app product detail page in the Samsung app store, or to your beta testing feedback channel address.
      • Before the scheduled end date, you can stop beta testing by suspending it.
         
  • Beta testers:
    • Must have the following devices:
      • To download the beta app:
        • For Android app beta tests:
          •  A Samsung Android phone model that is a distribution device in the beta app registration.
          • Minimum Galaxy Apps version required (currently 4.2.04).
             
        • For Gear app beta tests:
          • A Samsung Android phone model / Gear device combination that is a distribution device combination in the beta app registration.
          • Samsung Android phone:
            • Minimum Galaxy Apps version required (currently 4.2.04).
            • Paired with the Gear device, but not necessarily connected to the device.
               
        • To run the beta app:
          • Gear device with the minimum required Tizen platform version (currently 2.3.2).
             
    • Can only download the beta release app from the beta test download URL to their Samsung Android phone.
    • Testers registered in the app's Binary tab can download free beta apps and paid beta apps for free.
    • Testers registered in the Profile page can get an Android beta app's in-app items for free.
       
  • Was this article helpful?