Seamless wireless content sharing - revamping a screen-capturing mobile app

The goal was to create a seamless and reliable screen-sharing experience that could be used in various business and educational environments, enhancing collaboration and productivity.

Firstly, we needed to navigate the strict permissions requirements for screen recording on both Android and iOS platforms. For Android, the app needed to record the screen and audio, whereas iOS only permitted screen recording for third-party software, posing an initial obstacle.

The disparity in screen recording capabilities between iOS and Android added another layer of complexity. With the introduction of Android version 14, permissions for MediaProjection were altered significantly. If we requested screen recording permissions before displaying a notification, the result was a black screen recording. Conversely, if we displayed the notification before obtaining recording consent, the app would crash onto the home screen.

The restrictions on the iOS side were equally challenging. iOS generally does not allow apps to remain active in the background, which poses a significant limitation for continuous screen recording. Additionally, iOS does not permit audio capture from the screen, further complicating our goal of providing a seamless screen-sharing experience.

‍

We kicked off the execution phase by setting up all necessary environments and configuring Firebase, laying the groundwork for seamless development. Our team then began coding the design screens for both smartphones and tablets, ensuring a responsive and user-friendly interface.

Developing custom solutions for iOS required in-depth research and innovation to navigate the platform's strict permissions and background operation limitations, and we successfully accomplished this.

As development progressed, we also focused on understanding the requirements for publishing the app in the app stores. This involved creating marketing materials, instructional videos demonstrating how the device works, comprehensive app descriptions, and test versions.

‍

On the other hand, iOS allowed screen recording without significant hurdles, but we needed to create an extension for the existing app using a native screen recording module. Since the main app could not predict whether the user had started recording or simply closed the modal window of the native module, we implemented a workaround. Users could not exit the screen-sharing interface until native sharing had started, ensuring smooth operation. The same modal window allowed users to stop screen sharing.

Additionally, iOS typically does not permit apps to run in the background for extended periods. As a result, streaming would last only up to 15 seconds after the app transitioned to the background. To circumvent this, we implemented an artificial VoIP call connection. When users initiated screen sharing, we triggered a VoIP call, automatically placing it on hold and muting it. This kept the app active in the background. Users saw the call interface in the app's background and could end screen sharing by disconnecting the call.

Our innovative solutions and dedication to overcoming technical challenges paid off. The revamped app became a top performer, reaching number 7 on the bestsellers list in the business category on Google Play.

‍