Mobile platform A/B testing – Art or wizardry?

Yael Warman

Mobile trading platform development expert Alon Shmueli explains how critical cross-border testing is, from how to satisfy traders in markets where several operating systems are prominent, to ensuring the Chinese Firewall is taken into account where Android is blocked.

By Alon Shmueli, Mobile Team Leader, Leverate

Developing a successful trading app requires a lot of research and a little bit of wizardry. Everything form the color of a buy and sell button to the type of charts we make available and the steps required to join the system, play a huge role in the way in which we design our mobile trading apps in order to help our brokers convert and retain traders better.

When it comes to an app’s sign-up process, there is no one-size-fits-all and what may work for one business or industry may not work for another, so a little bit of A/B testing comes into play. A/B testing is simply a method of comparing the effectiveness of two versions against each other with a controlled sample of users.

unnamed
Alon Shmueli, Mobile Team Leader, Leverate

At Leverate, every feature of our apps we design or change has the ultimate goal of increasing conversion and/or retention of traders, so when we were tasked with redesigning the registration process in order to comply with EU regulation, A/B testing was the only way to solve the dilemma we faced: brokers on one hand, want to gather as much valuable information about a trader as possible and regulatory bodies have a say in what kind of data we must gather.

Traders on the other hand, want to disclose as little information about themselves as possible. Finding the right balance between acquiring the right amount of data from traders and avoiding turning them away because we are asking for too much of it is like walking on a tight rope.

In order to obtain real, quantifiable data to determine the correct and most effective sign-up format, the mobile team at Leverate designed two sign up forms: the first one, will include 5 pieces of data (name, e-mail address, phone number, country and password), while the second version will only include 2 pieces of data (password and e-mail address).

We will distribute both versions amongst users of iOS and Android and collect data using Google Analytics in order to determine:

A) whether the 5 item form is filled out as often as the 2 item form

B) If users quit half way through filling out the 5 item form, how many questions the majority of users filled out (this may help us determine if although 5 items may be too many, perhaps we can ask for more than the two we ask on the shorter form).

Often times, companies will do A/B testing with a sample group of users. In order to obtain the most accurate results however, we have decided it is best to use a wider, uncontrolled sample.

The main challenges when doing a full-scale A/B testing are first and foremost, the fact that we need to develop two full GUIs (Graphical User Interface) of the sign-up form for several operating systems (iOS for the latest two versions and while Android has users in versions going as far back as 3 years ago, we develop for the three most relevant

A second challenge we face is sampling in Asia. When doing A/B testing, timing is a concern and making the Android version of the app available in China, where Google is blocked by the Chinese Firewall, is more time-consuming, as is gathering results using alternate methods of Google Analytics.

A/B testing is a wonderful tool for developers to be able to determine the best course of action when implementing new tools or changing existing ones in an app and although the process is challenging and time-consuming, the rewards far outweigh the effort.

Read this next

Digital Assets

Sam Bankman-Fried might see his 25-year sentence halved

Sam Bankman-Fried, the founder of the failed cryptocurrency exchange FTX, was sentenced to 25 years in federal prison by a Manhattan court on Thursday. This comes after he was convicted of defrauding customers and investors, with Judge Lewis Kaplan highlighting the potential future risks posed by Bankman-Fried.

Technical Analysis

EURJPY Technical Analysis Report 28 March, 2024

EURJPY currency pair under the bearish pressure after the pair reversed down from the major resistance level 164.25, which also stopped the sharp weekly uptrend at the end of last year,

Digital Assets

BlockDAG’s Presale Hits $9.9M, MultiversX & MINA Price Predictions Show Green

Read about BlockDAG’s promising $10 prediction and insights on MultiversX Price Prediction as MINA’s potential unfolds.

Digital Assets

Rockstar Co-Founder and All-star Line Up Join Advisory Board to Take Metacade into Post Beta Orbit

Metacade, the revolutionary Web3 gaming platform, prepares to streak out of beta with a slew of ground-breaking initiatives that will redefine the way blockchain games are developed.

Retail FX

Prop firm The Funded Trader shuts down, claims relaunch in April

Prop trading firm The Funded Trader has ceased all operations, with claims for a relaunch in the near future.

Digital Assets

Ethereum-Based Tokenized Real Estate Platform USP Launches On Republic

How This Californian Startup Is Revolutionizing Real Estate Investment through Ethereum-Based Tokenization.

Digital Assets

Sui Spikes in Weekly DEX Volume, Joins Top 10 of All Blockchains

March DEX volume on Sui stands at over $2.88B – up more than 49% from February – with decentralized exchange Cetus and wholesale liquidity layer DeepBook leading.

Digital Assets

Prisma Finance suffers $10 million crypto exploit, attack ongoing

Liquid staking protocol Prisma Finance fell victim to a security exploit on March 28, resulting in nearly $10 million in Prisma mkUSD and wrapped stETH being stolen by hackers.

Digital Assets

Masa and LayerZero: Bridging Blockchains for Data Sovereignty

Masa Network is poised to revolutionize the personal data landscape with its upcoming launch as a cross-chain platform, making it accessible on a variety of blockchains right from the start.

<