WebProNews

Tag: A/B testing

  • Amazon Mobile App Developers Now Have Access To Analytics, A/B Testing

    Despite building Fire OS on top of Android, Amazon wants developers to choose its platform over Android or iOS when building apps. Over the last year, it’s become easier to recommend the platform as Amazon has leveraged the power of AWS to offer a number of services to developers that are typically hard to implement on their own.

    Amazon announced today that it’s continuing to add value to its platform with the addition of analytics and A/B testing to all developers who make apps for the Amazon Appstore. As the retailer notes, developers “who build their own analytics and testing solutions are forced to spend time on building and scaling backend services.” By providing the services through AWS, Amazon says developers can get back to doing what they do best – building content.

    “Mobile developers really want to understand how customers are using their app,” said Mike George, Vice President of Amazon Appstore, Games and Cloud Drive. “We’ve spent years at Amazon using data, analytics, and A/B testing to continually improve the experience of customers who shop with us. We wanted to bring those same advanced tools to mobile app developers to help them improve their customers’ experience.”

    Here’s what both the analytics and A/B testing services will bring to your apps:

  • Analytics – the Analytics service provides usage metrics on daily and monthly active devices, sessions, retention, and in-app purchase revenue. These metrics are updated continually and are available within 60 minutes of the data being received. When using this service, developers can quickly assess how, for example, launch day is going or how a new feature might be affecting retention.
  • A/B Testing – the A/B Testing service allows mobile developers to simultaneously test up to five different in-app experiences to understand which experience is most successful based on conversion, clicks, or other criteria they define. A developer simply needs to integrate the SDK and the service handles all of the complex statistical calculations on behalf of the developer. The service then presents the results in a simple web dashboard that shows which experience is most effective and statistically significant.

    • If you want to know more about analytics, check out Amazon’s page for the service. It includes a download for the beta SDK. As for A/B testing, go here to learn more and to grab the beta SDK download. Both tools are available for Android, Fire OS and iOS apps.

    [Image: Amazon Developers]

  • Amazon Now Provides Free A/B Testing To Mobile App Developers

    The Amazon Appstore is booming, and Kindle Fires are an even bigger hit this holiday season. Developers will want to jump on board to get some of the sweet revenue from the still growing Kindle market. Not to mention, Amazon provides some excellent tools for those who develop for its platforms and distribution channels.

    Amazon announced today that developers who go through its Amazon Mobile App Distribution Program will soon have access to free A/B testing. The free testing is built on Amazon’s own Web Services, and promises to scale with an app as it grows.

    The new A/B testing service will provide the following features to developers:

  • Free to Use: our A/B Testing service is free to use for developers distributing their app or game through the Amazon Mobile App Distribution Program.
  • Easy Integration: early partners report that the SDK can be integrated and ready for release in less than a day.
  • Precise Control: set up experiments and monitor results from the familiar Mobile App Distribution Portal.
  • Painless Deployment: server-side logic allows you to quickly iterate tests and deploy new, improved experiences to customers without having to resubmit your APK or write any additional client-side code.
  • Effortless Scaling: built on Amazon Web Services, Amazon’s A/B Testing service lets you focus on building great games and apps instead of architecting scalable backend services.

    • For those interested in free A/B testing, Amazon’s service is now available in beta. You can sign up for it here.

  • Clutch.io Refugees Can Find Solace In Convert.com

    Back in August, Twitter announced that they had acquired Clutch.io. It was one of the many “acquihires” that happen in the tech industry where Twitter was more interested in the talent instead of the product. As such, Twitter is ditching the Clutch.io platform and all support for it on November 1. Thankfully, they released the source code so developers could host their own applications built using Clutch.io, but what about those who don’t have the resources to host their own applications?

    Convert.com, a “leading A/B multivariate testing software for retailers and agencies” announced today that they would be picking up the slack for Clutch.io users. Any developer who used Clutch.io can move their apps from Clutch.io’s servers over to Convert.com by just signing-up with the service. It’s all part of Convert.com’s plan to break into the mobile space.

    “Retailers and agencies that support testing realize mobile is the future, and Convert.com’s strategy has always been to be on the forefront of innovative testing. Clutch.IO is a wonderful service. This is why we will open up our mobile beta program to both new and existing Clutch.IO users. We will begin fully supporting the Clutch.IO infrastructure by initially setting up the same exact hosted service current users are familiar with, then making the migration as smooth as possible for them” said Dennis van der Heijden, Convert.com’s CEO and Co-Founder.

    Convert.com’s integration with Clutch.io will be a two-phase project. The first phase will be integration with already existing apps built upon the exact same hosted Clutch.io service that existing users already know. After this initial beta period, apps will switch to Convert.com’s mobie platform for full integration with mobile Web sites and apps in one united platform.

    If you want to move your Clutch.io applications, you can sign up for the service over at Convert.com.

  • Content Experiments in Google Analytics Replace Google Website Optimizer

    Google announced the launch of Content Experiments in Google Analytics, as a way for webmasters to test different versions of pages to see which ones convert the best. It is replacing Google Website Optimizer, as it carries out much of the same functionality.

    “Over the last 5 years, it’s been great to see how many marketers and publishers have improved the web by using insights from Google Website Optimizer to create better site experiences,” says Nir Tzemah on the Google Analytics team.

    Website Optimizer will be going away on August 1.

    “Content Experiments helps you optimize for goals you have already defined in your Google Analytics account, and can help you decide which page designs, layouts and content are most effective,” explains Tzemah. “With Content Experiments, you can develop several versions of a page and show different versions to different visitors. Google Analytics measures the efficacy of each page version, and with a new advanced statistical engine, it determines the most effective version.”

    “Content Experiments is a somewhat different approach from either standard A/B or multivariate testing,” Google says in a help center article. “Content Experiments is more A/B/N. You’re not testing just two versions of a page as in A/B testing, and you’re not testing various combinations of components on a single page as in multivariate testing. Instead, you are testing up to five full versions of a single page, each delivered to visitors from a separate URL.”

    Content Experiments will let you test up to six variations of your page. It includes a setup wizard to walk you through the process, and uses Google Analytics tags so you only need to add one more tag to the original page.

    Daniel Waisberg at MarketingLand did a good enough job of pointing out the advantages of Google Analytics Content Experiments over Website Optimizer, that Google Analytics endorsed his bullet points in a Google+ post:

    Google Analytics
    Google Analytics   12 minutes ago Check out +Daniel Waisberg's post over at +Marketing Land on our just announced content experiments.

    Daniel outlines the advantages of content experiments over website optimizer, such as:

    –Only the control script will be necessary to run tests, the script that redirects the traffic from the original page to the variations.
    –Google Analytics advanced segments and page metrics will be available along with optimizing goal conversions based on your test pages. 
    –Improved statistical engine for analyzing experiments, which will help making decisions faster about the winning/loosing pages.
    Dynamic Traffic Allocation functionality: traffic will be shifted away from low-performing variations, over to higher performing ones.

    Be sure to read the whole post for even more detail.  4   0 Powered by socialditto

    Google also suggests reading what Cardinal Path has to say about A/B testing with Content Experiments:

    Google Analytics
    @googleanalytics     Check out @CardinalPath‘s take on A/B testing and Content Experiments: http://t.co/xUksKNdM
    2 minutes ago via TweetDeck · powered by @socialditto
     Reply  · Retweet  · Favorite

    Google says you should start any new experiments in Content Experiments, as opposed to Website Optimiser, given its pending demise. The feature will be rolling out to Google Analytics users over the next few weeks.