<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>Mobile on KnightLi Blog</title>
        <link>https://knightli.com/en/tags/mobile/</link>
        <description>Recent content in Mobile on KnightLi Blog</description>
        <generator>Hugo -- gohugo.io</generator>
        <language>en</language>
        <lastBuildDate>Fri, 29 May 2026 21:47:24 +0800</lastBuildDate><atom:link href="https://knightli.com/en/tags/mobile/index.xml" rel="self" type="application/rss+xml" /><item>
        <title>Which AI Mobile Automation Project Is Stronger? MobiAgent, Mobile-Agent, Mobilerun, and mobile-use Compared</title>
        <link>https://knightli.com/en/2026/05/29/mobile-gui-agent-projects-comparison/</link>
        <pubDate>Fri, 29 May 2026 21:47:24 +0800</pubDate>
        
        <guid>https://knightli.com/en/2026/05/29/mobile-gui-agent-projects-comparison/</guid>
        <description>&lt;p&gt;I recently organized four mobile GUI agent projects in a row: &lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobiagent-mobile-gui-agent-framework/&#34; &gt;MobiAgent&lt;/a&gt;, &lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobile-agent-gui-agent-family/&#34; &gt;Mobile-Agent&lt;/a&gt;, &lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobilerun-mobile-device-agent-framework/&#34; &gt;Mobilerun&lt;/a&gt;, and &lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobile-use-real-mobile-app-agent/&#34; &gt;mobile-use&lt;/a&gt;. They are all about &amp;ldquo;letting AI operate phones or mobile apps&amp;rdquo;, but their positioning is not the same.&lt;/p&gt;
&lt;p&gt;In short: MobiAgent is closer to a customizable research system for phone agents; Mobile-Agent is Tongyi Lab&amp;rsquo;s body of work around GUI agents; Mobilerun is more of a practical local/cloud mobile device control framework; and mobile-use emphasizes real app operation, task decomposition, data extraction, and AndroidWorld evaluation.&lt;/p&gt;
&lt;h2 id=&#34;basic-information-comparison&#34;&gt;Basic Information Comparison
&lt;/h2&gt;&lt;table&gt;
  &lt;thead&gt;
      &lt;tr&gt;
          &lt;th&gt;Project&lt;/th&gt;
          &lt;th&gt;Site Article&lt;/th&gt;
          &lt;th&gt;GitHub&lt;/th&gt;
          &lt;th&gt;Main Positioning&lt;/th&gt;
          &lt;th&gt;Device/Platform&lt;/th&gt;
          &lt;th&gt;License&lt;/th&gt;
          &lt;th&gt;Best For&lt;/th&gt;
      &lt;/tr&gt;
  &lt;/thead&gt;
  &lt;tbody&gt;
      &lt;tr&gt;
          &lt;td&gt;MobiAgent&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobiagent-mobile-gui-agent-framework/&#34; &gt;Site intro&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/IPADS-SAI/MobiAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;IPADS-SAI/MobiAgent&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;Customizable phone GUI agent system with models, runner, memory, acceleration, and evaluation&lt;/td&gt;
          &lt;td&gt;Mainly Android/Harmony phones&lt;/td&gt;
          &lt;td&gt;Apache-2.0&lt;/td&gt;
          &lt;td&gt;Researchers and mobile agent experiment teams&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Mobile-Agent&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobile-agent-gui-agent-family/&#34; &gt;Site intro&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/X-PLUG/MobileAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;X-PLUG/MobileAgent&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;Tongyi Lab GUI agent family covering mobile, desktop, browser, and tool use&lt;/td&gt;
          &lt;td&gt;Phones, PCs, web pages, cloud phones/cloud desktops&lt;/td&gt;
          &lt;td&gt;MIT&lt;/td&gt;
          &lt;td&gt;People tracking GUI agent technology paths&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Mobilerun&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobilerun-mobile-device-agent-framework/&#34; &gt;Site intro&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/droidrun/mobilerun&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;droidrun/mobilerun&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;LLM-agnostic mobile device agent framework with CLI, Python API, and cloud device workflows&lt;/td&gt;
          &lt;td&gt;Android, iOS, local devices, cloud devices&lt;/td&gt;
          &lt;td&gt;MIT&lt;/td&gt;
          &lt;td&gt;Developers, QA, and automation workflow teams&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;mobile-use&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://knightli.com/en/2026/05/29/mobile-use-real-mobile-app-agent/&#34; &gt;Site intro&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/minitap-ai/mobile-use&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;minitap-ai/mobile-use&lt;/a&gt;&lt;/td&gt;
          &lt;td&gt;Operates real mobile apps through natural language, with task decomposition, structured extraction, and AndroidWorld focus&lt;/td&gt;
          &lt;td&gt;Android devices/emulators, iOS simulators&lt;/td&gt;
          &lt;td&gt;Apache-2.0&lt;/td&gt;
          &lt;td&gt;People building mobile app agents, data extraction, and evaluations&lt;/td&gt;
      &lt;/tr&gt;
  &lt;/tbody&gt;
&lt;/table&gt;
&lt;h2 id=&#34;mobiagent&#34;&gt;MobiAgent
&lt;/h2&gt;&lt;p&gt;MobiAgent comes from IPADS-SAI and is positioned as a customizable phone agent system. It is not just an execution script. It puts the MobiMind model family, AgentRR action recording and replay, the MobiFlow benchmark, phone runners, data collection, and an Android app into one system.&lt;/p&gt;
&lt;p&gt;Its main strength is the completeness of the research system. MobiAgent cares about accuracy, efficiency, memory, and reusable action sequences in real phone tasks. The user profile memory, experience memory, action memory, and multi-task execution mentioned in the README all show that it is trying to handle long-horizon and repeated tasks.&lt;/p&gt;
&lt;p&gt;Its entry barrier is also relatively high. A full setup requires devices, ADB, model deployment, dependencies, and optional vector database and graph database configuration. It is better suited to research or engineering experiments than to an &amp;ldquo;install and use immediately&amp;rdquo; phone assistant for ordinary users.&lt;/p&gt;
&lt;h2 id=&#34;mobile-agent&#34;&gt;Mobile-Agent
&lt;/h2&gt;&lt;p&gt;Mobile-Agent comes from X-PLUG/Tongyi Lab. The repository has grown from an early phone operation agent into a GUI agent family: Mobile-Agent-v1/v2/v3/v3.5, Mobile-Agent-E, PC-Agent, GUI-Critic-R1, UI-S1, GUI-Owl, ToolCUA, and more all sit on the same technical line.&lt;/p&gt;
&lt;p&gt;Its defining feature is breadth. Mobile-Agent is not only about phones; it also covers desktop, browser, cloud phones, cloud desktops, GUI perception, grounding, error diagnosis, reinforcement learning, and GUI/tool path orchestration. The GUI-Owl model series makes it feel more like a cross-platform GUI agent foundation-model track than a single mobile automation project.&lt;/p&gt;
&lt;p&gt;The weakness also comes from that breadth: the repository is more like a collection of research results, so users first need to decide which subproject, model, and scenario they actually want to run. It is good for tracking technical evolution and reproducing experiments, but it may not be the fastest choice for plugging into a business workflow.&lt;/p&gt;
&lt;h2 id=&#34;mobilerun&#34;&gt;Mobilerun
&lt;/h2&gt;&lt;p&gt;Mobilerun comes from droidrun and is more engineering-oriented: it lets LLM agents control Android and iOS devices through natural language. It provides CLI, TUI, Docker, Python API, portal-based control, vision mode, reasoning mode, structured output, custom tools, app cards, execution traces, and cloud device services.&lt;/p&gt;
&lt;p&gt;Its most prominent quality is model agnosticism and clear deployment shape. Developers can connect OpenAI, Anthropic, Gemini, Ollama, DeepSeek, OpenRouter, or OpenAI-compatible providers; they can also choose a local framework or Mobilerun Cloud. For real teams, this separation between the device control layer and the model layer matters a lot.&lt;/p&gt;
&lt;p&gt;It still has the usual mobile automation barriers. Android requires developer options, USB debugging, and the Portal app; iOS has a separate flow; complex tasks also need to handle permission popups, page changes, retries after failure, and log investigation. It is better for people willing to use mobile agents as engineering components.&lt;/p&gt;
&lt;h2 id=&#34;mobile-use&#34;&gt;mobile-use
&lt;/h2&gt;&lt;p&gt;mobile-use comes from minitap-ai and aims to let AI agents use real Android and iOS apps. It supports natural-language control, UI-aware automation, data extraction, and different LLM configurations, and it emphasizes AndroidWorld benchmark performance. Its README also says the project is the first agentic framework to reach 100% on the AndroidWorld benchmark.&lt;/p&gt;
&lt;p&gt;Its highlight is task decomposition and structured extraction. For example, finding unread email in Gmail and returning the sender and subject in a specified JSON format is much closer to real production needs than simply &amp;ldquo;opening Settings and checking the battery level&amp;rdquo;. It pushes mobile GUI agents from &amp;ldquo;can operate&amp;rdquo; toward &amp;ldquo;can organize information from apps&amp;rdquo;.&lt;/p&gt;
&lt;p&gt;Its limitations are mainly device support and runtime environment. Android can use physical phones or emulators; iOS currently mainly supports simulators on macOS, while physical iOS devices are not yet supported. Docker quick start is also mainly aimed at Android. When evaluating it, first confirm whether the target device and app scenario are covered by the current execution path.&lt;/p&gt;
&lt;h2 id=&#34;feature-comparison&#34;&gt;Feature Comparison
&lt;/h2&gt;&lt;table&gt;
  &lt;thead&gt;
      &lt;tr&gt;
          &lt;th&gt;Feature Dimension&lt;/th&gt;
          &lt;th&gt;MobiAgent&lt;/th&gt;
          &lt;th&gt;Mobile-Agent&lt;/th&gt;
          &lt;th&gt;Mobilerun&lt;/th&gt;
          &lt;th&gt;mobile-use&lt;/th&gt;
      &lt;/tr&gt;
  &lt;/thead&gt;
  &lt;tbody&gt;
      &lt;tr&gt;
          &lt;td&gt;Natural-language tasks&lt;/td&gt;
          &lt;td&gt;Supported&lt;/td&gt;
          &lt;td&gt;Supported&lt;/td&gt;
          &lt;td&gt;Supported&lt;/td&gt;
          &lt;td&gt;Supported&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Real phone operation&lt;/td&gt;
          &lt;td&gt;Strong, Android/Harmony oriented&lt;/td&gt;
          &lt;td&gt;Strong, includes mobile and cloud phones&lt;/td&gt;
          &lt;td&gt;Strong, Android/iOS&lt;/td&gt;
          &lt;td&gt;Strong, Android; iOS leans simulator&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Desktop/browser expansion&lt;/td&gt;
          &lt;td&gt;Not the focus&lt;/td&gt;
          &lt;td&gt;Strong, includes PC-Agent, GUI-Owl, ToolCUA&lt;/td&gt;
          &lt;td&gt;Not the main positioning&lt;/td&gt;
          &lt;td&gt;Not the main positioning&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Model layer&lt;/td&gt;
          &lt;td&gt;Includes MobiMind series&lt;/td&gt;
          &lt;td&gt;GUI-Owl and Mobile-Agent series&lt;/td&gt;
          &lt;td&gt;LLM-agnostic, connects many models&lt;/td&gt;
          &lt;td&gt;Configurable with multiple LLMs&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Executor/runner&lt;/td&gt;
          &lt;td&gt;Strong, includes ADB runner and multi-task runner&lt;/td&gt;
          &lt;td&gt;Provided separately by subprojects&lt;/td&gt;
          &lt;td&gt;Strong, CLI/TUI/Python API/Docker&lt;/td&gt;
          &lt;td&gt;Source code, Docker, and platform entry points&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Memory ability&lt;/td&gt;
          &lt;td&gt;User profile, experience, and action memory&lt;/td&gt;
          &lt;td&gt;v3/v3.5 emphasize memory and reflection&lt;/td&gt;
          &lt;td&gt;More about traces, logs, and engineering debugging&lt;/td&gt;
          &lt;td&gt;More about task decomposition and stateful execution&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Evaluation&lt;/td&gt;
          &lt;td&gt;MobiFlow&lt;/td&gt;
          &lt;td&gt;Multiple paper/benchmark directions&lt;/td&gt;
          &lt;td&gt;Has benchmark result entry points&lt;/td&gt;
          &lt;td&gt;Strong AndroidWorld performance&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Cloud devices&lt;/td&gt;
          &lt;td&gt;Not the main selling point&lt;/td&gt;
          &lt;td&gt;Supports cloud phone/cloud desktop experiences&lt;/td&gt;
          &lt;td&gt;Mobilerun Cloud is a focus&lt;/td&gt;
          &lt;td&gt;Has platform entry points&lt;/td&gt;
      &lt;/tr&gt;
      &lt;tr&gt;
          &lt;td&gt;Structured output&lt;/td&gt;
          &lt;td&gt;Can be implemented through engineering flows&lt;/td&gt;
          &lt;td&gt;Depends on the subproject&lt;/td&gt;
          &lt;td&gt;Explicitly supported&lt;/td&gt;
          &lt;td&gt;Explicitly supported&lt;/td&gt;
      &lt;/tr&gt;
  &lt;/tbody&gt;
&lt;/table&gt;
&lt;h2 id=&#34;strengths-and-weaknesses&#34;&gt;Strengths and Weaknesses
&lt;/h2&gt;&lt;p&gt;MobiAgent&amp;rsquo;s strength is system completeness. It is suitable for studying the closed loop of models, memory, acceleration, and evaluation for phone GUI agents. Its weakness is the long deployment chain, heavy engineering configuration, and relatively high onboarding cost for ordinary developers.&lt;/p&gt;
&lt;p&gt;Mobile-Agent&amp;rsquo;s strength is the broadest technical path. It shows GUI agents evolving from phones to desktops, browsers, tool use, and foundation models. Its weakness is the complexity of the project family: if you want to land one specific scenario directly, you need to do more filtering first.&lt;/p&gt;
&lt;p&gt;Mobilerun&amp;rsquo;s strength is a clear engineering interface, model agnosticism, and explicit separation between local framework and cloud service. It is suitable for integrating mobile device automation into products or internal tools. Its weakness is that it still has to deal with mobile device permissions, environments, app state, and cloud cost.&lt;/p&gt;
&lt;p&gt;mobile-use&amp;rsquo;s strength is its focus on real app usage, task decomposition, and structured data extraction. The AndroidWorld angle also makes it easier to evaluate. Its weakness is limited support for physical iOS devices, and a complete setup still requires model, device, and runtime configuration.&lt;/p&gt;
&lt;h2 id=&#34;suggested-use-cases&#34;&gt;Suggested Use Cases
&lt;/h2&gt;&lt;p&gt;If you want to research mobile agents, look first at MobiAgent and Mobile-Agent. The former focuses more on a closed loop for phone-side systems, while the latter is better for observing the cross-platform evolution of GUI agents.&lt;/p&gt;
&lt;p&gt;If you want mobile app automation, QA, data extraction, or internal workflows, look first at Mobilerun and mobile-use. Mobilerun is more like a runtime framework that can plug into engineering systems, while mobile-use is better for validating natural-language app operation and structured extraction.&lt;/p&gt;
&lt;p&gt;If you care about future personal-assistant forms, all four are worth tracking. MobiAgent represents systematic research on phone agents, Mobile-Agent represents the cross-platform GUI agent path, Mobilerun represents device-control infrastructure, and mobile-use represents real-app task decomposition and evaluation-driven development.&lt;/p&gt;
&lt;h2 id=&#34;my-take&#34;&gt;My Take
&lt;/h2&gt;&lt;p&gt;The differences between these four projects show that mobile GUI agents are no longer just about &amp;ldquo;letting a model look at screenshots and tap buttons&amp;rdquo;. The real questions have become: how models understand interfaces, how executors control devices reliably, how tasks are decomposed and evaluated, how cloud devices are managed, how results are returned in structured form, and how risks are constrained.&lt;/p&gt;
&lt;p&gt;In the short term, the most realistic landing scenarios are QA, data extraction, internal workflow automation, and controlled device pools. In the long run, whoever can stabilize device control, model capability, permission boundaries, log tracing, and user confirmation mechanisms will be closer to a truly usable mobile AI assistant.&lt;/p&gt;
</description>
        </item>
        <item>
        <title>mobile-use Highlights: Let AI Operate Real Apps and Extract Data</title>
        <link>https://knightli.com/en/2026/05/29/mobile-use-real-mobile-app-agent/</link>
        <pubDate>Fri, 29 May 2026 21:43:46 +0800</pubDate>
        
        <guid>https://knightli.com/en/2026/05/29/mobile-use-real-mobile-app-agent/</guid>
        <description>&lt;p&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/minitap-ai/mobile-use&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;mobile-use&lt;/a&gt; is minitap-ai&amp;rsquo;s open source mobile AI agent framework. Its goal is to let agents use real Android and iOS apps like humans. Users describe tasks in natural language; the framework understands the interface, operates the app, and returns results to the caller.&lt;/p&gt;
&lt;p&gt;From the README, mobile-use is not only about &amp;ldquo;being able to tap a phone&amp;rdquo;. It also emphasizes UI-aware automation, data extraction, configurable models, and AndroidWorld benchmark performance. The project also provides cloud platform, documentation, and paper entry points, suggesting that it is both an open source framework and a product/research system around mobile agents.&lt;/p&gt;
&lt;h2 id=&#34;how-it-differs-from-ordinary-phone-automation&#34;&gt;How It Differs From Ordinary Phone Automation
&lt;/h2&gt;&lt;p&gt;Traditional phone automation usually relies on scripts, coordinates, control IDs, or fixed flows. It works for stable pages, but easily breaks when interfaces change, popups appear, search results differ, lists scroll, or operations cross apps.&lt;/p&gt;
&lt;p&gt;mobile-use&amp;rsquo;s route is to let AI agents directly handle natural-language goals and UI state:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Users describe tasks in natural language instead of hard-coding every step.&lt;/li&gt;
&lt;li&gt;The framework reads the mobile interface and uses the model to decide the next action.&lt;/li&gt;
&lt;li&gt;It can extract information from apps and return it in a specified format, such as JSON.&lt;/li&gt;
&lt;li&gt;It supports different LLM configurations, including OpenAI API compatible providers.&lt;/li&gt;
&lt;li&gt;Android can run on physical phones or emulators; iOS currently mainly targets simulators on macOS.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This kind of framework is better suited to &amp;ldquo;semi-structured&amp;rdquo; mobile tasks: the goal is clear, but page state, data content, and path may vary each time.&lt;/p&gt;
&lt;h2 id=&#34;androidworld-results-are-worth-noting&#34;&gt;AndroidWorld Results Are Worth Noting
&lt;/h2&gt;&lt;p&gt;The mobile-use README says the project reached 100% completion on the AndroidWorld benchmark and links to the corresponding paper. Whatever the evaluation details are, this shows that the team places high importance on task decomposition and evaluable execution.&lt;/p&gt;
&lt;p&gt;That matters more than a simple demo. A common GUI-agent problem is that it can look smart in one video but become unstable when the task, device, or initial state changes. Benchmarks do not fully represent real use, but they force the system to face standardized tasks and expose planning, grounding, recovery, and state-understanding ability.&lt;/p&gt;
&lt;p&gt;The paper title linked in the README also points to the direction: improving AndroidWorld accuracy through task decomposition. For mobile agents, complex tasks often cannot be completed by one big prompt; they need to be broken into executable subtasks, with state checked at each step.&lt;/p&gt;
&lt;h2 id=&#34;data-extraction-is-a-practical-entry-point&#34;&gt;Data Extraction Is a Practical Entry Point
&lt;/h2&gt;&lt;p&gt;One realistic use case for mobile-use is extracting data from native apps. Much information is not exposed through APIs and can only be viewed inside app interfaces, such as email lists, order status, social content, admin dashboards, and notifications.&lt;/p&gt;
&lt;p&gt;The README example opens Gmail, finds unread emails, and returns sender and subject as JSON. This is practical because it moves mobile GUI agents from &amp;ldquo;help me operate something&amp;rdquo; to &amp;ldquo;help me structure information from inside an app&amp;rdquo;.&lt;/p&gt;
&lt;p&gt;But this also creates boundaries. Data extraction involves accounts, privacy, platform terms, and access permissions. Real usage should clearly define device ownership, task authorization, data retention, and output scope. A phone interface should not be treated as an unlimited data source.&lt;/p&gt;
&lt;h2 id=&#34;deployment-barriers-and-limits&#34;&gt;Deployment Barriers and Limits
&lt;/h2&gt;&lt;p&gt;mobile-use supports quick start from the platform and running from source. Source-based use requires &lt;code&gt;.env&lt;/code&gt;, LLM configuration, and dependencies. Android can use physical phones or emulators, and Docker quick start is currently mainly aimed at Android. iOS requires macOS, Xcode, and Facebook&amp;rsquo;s iOS Development Bridge, and the README says physical iOS devices are not currently supported.&lt;/p&gt;
&lt;p&gt;These limitations are not surprising. Mobile automation depends more on devices, system permissions, and debugging channels than browser automation does. iOS is especially closed. Stable simulator access is already valuable, but it is still far from &amp;ldquo;automating any real iPhone&amp;rdquo;.&lt;/p&gt;
&lt;p&gt;So when evaluating mobile-use, do not only look at model performance. Also check whether your target device, app type, runtime environment, and compliance boundary match.&lt;/p&gt;
&lt;h2 id=&#34;who-should-follow-it&#34;&gt;Who Should Follow It
&lt;/h2&gt;&lt;p&gt;mobile-use is worth following for:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Researchers studying AndroidWorld, mobile GUI agents, and task decomposition.&lt;/li&gt;
&lt;li&gt;Developers who want to connect natural-language mobile operation to internal tools.&lt;/li&gt;
&lt;li&gt;Teams that need structured data extraction from native apps.&lt;/li&gt;
&lt;li&gt;People doing mobile app QA, regression testing, or exploratory testing.&lt;/li&gt;
&lt;li&gt;People comparing different mobile-agent routes such as mobile-use, Mobilerun, and Mobile-Agent.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;If the goal is a consumer-facing phone assistant, it is still more of an engineering and research framework. If the goal is to validate mobile agent feasibility, it provides a very concrete open source starting point.&lt;/p&gt;
&lt;h2 id=&#34;my-take&#34;&gt;My Take
&lt;/h2&gt;&lt;p&gt;mobile-use stands out because it puts real app operation, structured data extraction, and benchmark evaluation in one project. It is not just a wrapper for &amp;ldquo;tap the phone with natural language&amp;rdquo;; it tries to decompose mobile tasks into executable, evaluable, reproducible agent flows.&lt;/p&gt;
&lt;p&gt;Mobile will be an important battlefield for GUI agents because many personal and business tasks happen inside apps rather than web pages or APIs. Projects like mobile-use help agents move from chat windows into real application interfaces. It has not erased all device, permission, and risk issues, but it already gives developers a concrete experimentation platform.&lt;/p&gt;
&lt;p&gt;Project link: &lt;a class=&#34;link&#34; href=&#34;https://github.com/minitap-ai/mobile-use&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;minitap-ai/mobile-use&lt;/a&gt;&lt;/p&gt;
</description>
        </item>
        <item>
        <title>Want AI to Tap Your Phone Automatically? Mobilerun Supports Android and iOS</title>
        <link>https://knightli.com/en/2026/05/29/mobilerun-mobile-device-agent-framework/</link>
        <pubDate>Fri, 29 May 2026 21:43:45 +0800</pubDate>
        
        <guid>https://knightli.com/en/2026/05/29/mobilerun-mobile-device-agent-framework/</guid>
        <description>&lt;p&gt;&lt;a class=&#34;link&#34; href=&#34;https://github.com/droidrun/mobilerun&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Mobilerun&lt;/a&gt; is droidrun&amp;rsquo;s open source mobile device automation framework. Its goal is to let LLM agents control Android and iOS devices through natural language. It provides native mobile tools so agents can inspect UI state, understand screenshots, tap, swipe, type, plan multi-step tasks, and return results through CLI or Python API.&lt;/p&gt;
&lt;p&gt;The project&amp;rsquo;s positioning is clear: it does not bind itself to one model vendor, but works as the execution layer between mobile devices and agents. The README lists model sources including OpenAI, Anthropic, Gemini, Ollama, DeepSeek, OpenRouter, and OpenAI-compatible providers. For developers, this is more practical than a demo project that only supports one model.&lt;/p&gt;
&lt;h2 id=&#34;what-problem-it-solves&#34;&gt;What Problem It Solves
&lt;/h2&gt;&lt;p&gt;The hardest part of mobile automation is that many layers sit between a natural-language task and real device operation. The model needs to know which app is open, what controls are on the page, whether screenshots are needed for visual context, where to tap next, and how to continue after failure.&lt;/p&gt;
&lt;p&gt;Mobilerun organizes these capabilities into a framework:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Run one-off natural-language tasks, inspect devices, replay macros, and debug flows through CLI and TUI.&lt;/li&gt;
&lt;li&gt;Build custom mobile automation workflows through Python API.&lt;/li&gt;
&lt;li&gt;Support Android and iOS. Android uses Portal app and accessibility; iOS follows a separate Portal flow.&lt;/li&gt;
&lt;li&gt;Combine accessibility tree and screenshots so the model can read structured UI and visual context.&lt;/li&gt;
&lt;li&gt;Support modes such as &lt;code&gt;--vision&lt;/code&gt;, &lt;code&gt;--vision-only&lt;/code&gt;, and &lt;code&gt;--reasoning&lt;/code&gt; for tasks of different complexity.&lt;/li&gt;
&lt;li&gt;Support structured output, app cards, custom tools, credentials, and execution trace tracking.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This makes Mobilerun feel more like a &amp;ldquo;mobile agent runtime&amp;rdquo; than a simple screenshot-to-LLM tap simulator.&lt;/p&gt;
&lt;h2 id=&#34;local-framework-and-cloud-service&#34;&gt;Local Framework and Cloud Service
&lt;/h2&gt;&lt;p&gt;Mobilerun separates the local framework and Mobilerun Cloud clearly. The local framework is for developers running agents on their own machines and devices with stronger code-level control. Cloud targets hosted devices, REST API, SDKs, and scaled workflows.&lt;/p&gt;
&lt;p&gt;This layering matters. Many mobile automation scenarios begin as &amp;ldquo;help me run one task on a phone&amp;rdquo;, but once teams adopt them, device management, concurrency, logs, retries, permissions, and API calls all appear. Cloud does not replace the local framework; it pushes device operations and workflow integration toward backend services.&lt;/p&gt;
&lt;p&gt;The README also distinguishes several types of cloud devices: user-owned hardware, hosted cloud phones, and hosted physical phones. The difference is not only cost; it also affects app risk control, identity trust, and task stability. For e-commerce, social, finance, or local-service apps, real devices and virtual devices may behave very differently.&lt;/p&gt;
&lt;h2 id=&#34;why-llm-agnostic-matters&#34;&gt;Why LLM-Agnostic Matters
&lt;/h2&gt;&lt;p&gt;Mobile GUI agents are still changing quickly, so it is hard to say which model will be best long term. Different tasks also need different model strengths: some rely more on visual understanding, some on long-horizon planning, some on tool use, and some on low-cost batch execution.&lt;/p&gt;
&lt;p&gt;Mobilerun&amp;rsquo;s model-agnostic route separates device control, task execution, log tracing, and model choice. Developers can stabilize the device-side flow first, then switch models based on cost, accuracy, and latency.&lt;/p&gt;
&lt;p&gt;This helps real deployment. Enterprises will not rewrite the device control layer just because one model demo looks good. It is more reasonable to keep a unified execution framework and treat the model as a replaceable component.&lt;/p&gt;
&lt;h2 id=&#34;suitable-scenarios&#34;&gt;Suitable Scenarios
&lt;/h2&gt;&lt;p&gt;Mobilerun currently fits several needs:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Mobile app QA and regression testing.&lt;/li&gt;
&lt;li&gt;Extracting data from native apps and returning structured results.&lt;/li&gt;
&lt;li&gt;Automatically executing repetitive phone tasks.&lt;/li&gt;
&lt;li&gt;Packaging natural-language mobile operation flows for non-technical users.&lt;/li&gt;
&lt;li&gt;Running automation tasks across multiple devices.&lt;/li&gt;
&lt;li&gt;Connecting schedules, notifications, or custom triggers to mobile workflows.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;It is not yet a consumer-grade assistant that takes over your phone immediately after installation. Android requires ADB, developer options, USB debugging, and the Portal app; iOS has its own integration flow. To run reliably, you still need model configuration, device state handling, permission popups, and task failure recovery.&lt;/p&gt;
&lt;h2 id=&#34;my-take&#34;&gt;My Take
&lt;/h2&gt;&lt;p&gt;Mobilerun&amp;rsquo;s value is that it turns mobile device control into a programmable, observable, model-replaceable agent framework. It recognizes that mobile automation is not only a model problem, but a system problem involving models, devices, executors, logs, tools, and cloud infrastructure.&lt;/p&gt;
&lt;p&gt;In the short term, it is suitable for developers building mobile automation prototypes and internal tools. In the long term, frameworks like this may become &amp;ldquo;AI workflow engines on phones&amp;rdquo;. If GUI agents are to enter real business use, projects that combine local execution, cloud devices, structured output, and traceability will become increasingly important.&lt;/p&gt;
&lt;p&gt;Project link: &lt;a class=&#34;link&#34; href=&#34;https://github.com/droidrun/mobilerun&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;droidrun/mobilerun&lt;/a&gt;&lt;/p&gt;
</description>
        </item>
        <item>
        <title>Can AI Tap Phones and Use Computers by Itself? A Reading of the Mobile-Agent Project</title>
        <link>https://knightli.com/en/2026/05/29/mobile-agent-gui-agent-family/</link>
        <pubDate>Fri, 29 May 2026 21:42:41 +0800</pubDate>
        
        <guid>https://knightli.com/en/2026/05/29/mobile-agent-gui-agent-family/</guid>
        <description>&lt;p&gt;X-PLUG&amp;rsquo;s open source &lt;a class=&#34;link&#34; href=&#34;https://github.com/X-PLUG/MobileAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Mobile-Agent&lt;/a&gt; is no longer just a phone automation project. Based on the repository&amp;rsquo;s current positioning, it is more like a set of GUI-agent work accumulated by Tongyi Lab: Mobile-Agent-v1/v2/v3/v3.5, Mobile-Agent-E, PC-Agent, GUI-Critic-R1, UI-S1, GUI-Owl, ToolCUA, and more are all presented inside the same project system.&lt;/p&gt;
&lt;p&gt;This line is worth watching. In the past, GUI agent discussions often centered on whether a model could understand a screenshot and tap the right place. Mobile-Agent goes further: it tries to let agents switch among mobile, desktop, browser, and tool use, handling longer and more complex real tasks.&lt;/p&gt;
&lt;h2 id=&#34;what-problem-it-solves&#34;&gt;What Problem It Solves
&lt;/h2&gt;&lt;p&gt;GUI agents do not face standard APIs; they face application interfaces. They need to understand the screen, locate controls, plan steps, perform taps or typing, and correct their path after failure. Mobile scenarios are especially complex because tasks often cross multiple apps, and interface state changes with login, permissions, popups, network conditions, and personalized recommendations.&lt;/p&gt;
&lt;p&gt;The Mobile-Agent series breaks the problem into several directions:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Mobile-Agent-v1/v2 explore visual perception and multi-agent collaboration for phone GUIs.&lt;/li&gt;
&lt;li&gt;PC-Agent extends multi-agent operation to PC scenarios.&lt;/li&gt;
&lt;li&gt;Mobile-Agent-v3 and v3.5 advance a multi-platform GUI agent framework.&lt;/li&gt;
&lt;li&gt;GUI-Owl models provide cross-platform GUI perception, grounding, and end-to-end operation.&lt;/li&gt;
&lt;li&gt;GUI-Critic-R1, UI-S1, ToolCUA, and related work add error diagnosis, reinforcement learning, and GUI/tool path orchestration.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This makes it less like a single demo and more like a research and engineering path around &amp;ldquo;computer-use agents&amp;rdquo;.&lt;/p&gt;
&lt;h2 id=&#34;the-focus-of-v35&#34;&gt;The Focus of v3.5
&lt;/h2&gt;&lt;p&gt;The repository README shows that Mobile-Agent-v3.5 can be experienced through ModelScope online demo and Alibaba Cloud Bailian online demo, and Bailian also provides a v3.5 API. In March 2026, v3.5 also launched on Alibaba Cloud Wuying cloud phones, offering mobile-use experiences in cloud Android environments.&lt;/p&gt;
&lt;p&gt;This suggests the project is filling in usage modes beyond &amp;ldquo;run experiments locally&amp;rdquo;. For GUI agents, cloud phones and cloud desktops matter: they provide more stable and reproducible runtime environments, reducing differences caused by local devices, OS versions, resolution, and app state.&lt;/p&gt;
&lt;p&gt;If you want to evaluate this kind of agent, a stable environment is easy to underestimate. Without a controllable execution environment, it is hard to know whether a failure came from weak model capability, interface changes, device issues, or an unclear task definition.&lt;/p&gt;
&lt;h2 id=&#34;gui-owl-is-a-deeper-change&#34;&gt;GUI-Owl Is a Deeper Change
&lt;/h2&gt;&lt;p&gt;After Mobile-Agent-v3, GUI-Owl became a key model layer in this line. The README describes GUI-Owl as a multimodal cross-platform GUI VLM with GUI perception, grounding, and end-to-end operation ability. By GUI-Owl-1.5, the model series covers 2B, 4B, 8B, 32B, and 235B, and supports desktop, mobile, and browser automation.&lt;/p&gt;
&lt;p&gt;The significance of this kind of model is that it does not only answer &amp;ldquo;what is on the screen&amp;rdquo;. It must connect the natural-language goal, screenshot content, UI element positions, and next operation. For GUI agents, visual understanding, coordinate grounding, action planning, and state memory are all necessary.&lt;/p&gt;
&lt;p&gt;Of course, the more general the model becomes, the more important engineering boundaries are. Real deployment still needs executors, permission control, task logs, rollback mechanisms, and human confirmation. For high-risk actions involving payment, accounts, files, or message sending, a GUI agent must not only complete tasks automatically; it must also clearly explain what it is about to do.&lt;/p&gt;
&lt;h2 id=&#34;the-direction-implied-by-toolcua&#34;&gt;The Direction Implied by ToolCUA
&lt;/h2&gt;&lt;p&gt;In May 2026, project news mentioned ToolCUA, positioned as an end-to-end Computer Use Agent for optimal GUI and tool path orchestration. This direction is interesting because it recognizes a practical fact: not every task should be completed by clicking through screens.&lt;/p&gt;
&lt;p&gt;Some work suits GUI operation, such as logging into back offices, handling complex forms, or reading app state without APIs. Some work is better done through tools, such as search, calculation, file parsing, or structured interface access. A usable computer-use agent needs to learn when to switch between the two.&lt;/p&gt;
&lt;p&gt;This is why the Mobile-Agent series is more worth watching than early phone automation projects. It no longer only asks whether an agent can tap apps like a human. It asks when an agent should look at the screen, when it should use tools, and when it should stop for confirmation.&lt;/p&gt;
&lt;h2 id=&#34;who-should-follow-it&#34;&gt;Who Should Follow It
&lt;/h2&gt;&lt;p&gt;If you only want an out-of-the-box phone automation assistant, Mobile-Agent is still more of a research and engineering framework. It involves models, runtime environments, evaluation tasks, and concrete executors, so a complete run usually has setup cost.&lt;/p&gt;
&lt;p&gt;But if you care about the following questions, it is worth tracking:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;How mobile GUI agents move from demos to stable execution.&lt;/li&gt;
&lt;li&gt;Whether desktop, browser, and phone automation can be unified under one agent framework.&lt;/li&gt;
&lt;li&gt;How GUI models handle grounding, reflection, memory, and error diagnosis.&lt;/li&gt;
&lt;li&gt;How agents choose between GUI operation and tool use.&lt;/li&gt;
&lt;li&gt;Whether cloud phones and cloud desktops will become important runtime environments for GUI agents.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;These questions directly affect personal assistants, enterprise workflow automation, remote desktop operation, app testing, and integration with systems that lack APIs.&lt;/p&gt;
&lt;h2 id=&#34;my-take&#34;&gt;My Take
&lt;/h2&gt;&lt;p&gt;The value of Mobile-Agent is not one version&amp;rsquo;s metrics, but that it pushes GUI agents from &amp;ldquo;phone screenshot and tap&amp;rdquo; into a larger system problem: how models, execution environments, evaluation, tool use, error diagnosis, and cross-platform tasks cooperate.&lt;/p&gt;
&lt;p&gt;In the short term, it is better suited for researchers and developers observing the technical path of GUI agents. In the long term, projects like this may influence the shape of personal AI assistants and enterprise automation tools. The real difficulty is not only making an agent operate interfaces, but making it complete tasks in real applications in a stable, controllable, and traceable way.&lt;/p&gt;
&lt;p&gt;Project link: &lt;a class=&#34;link&#34; href=&#34;https://github.com/X-PLUG/MobileAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;X-PLUG/MobileAgent&lt;/a&gt;&lt;/p&gt;
</description>
        </item>
        <item>
        <title>What Is MobiAgent? An Open Source AI Agent That Can Operate Mobile Apps</title>
        <link>https://knightli.com/en/2026/05/29/mobiagent-mobile-gui-agent-framework/</link>
        <pubDate>Fri, 29 May 2026 21:36:58 +0800</pubDate>
        
        <guid>https://knightli.com/en/2026/05/29/mobiagent-mobile-gui-agent-framework/</guid>
        <description>&lt;p&gt;IPADS-SAI has open sourced &lt;a class=&#34;link&#34; href=&#34;https://github.com/IPADS-SAI/MobiAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;MobiAgent&lt;/a&gt;, a customizable agent framework for mobile GUIs. It is not a single model repository. Instead, it puts models, executors, acceleration mechanisms, benchmarks, and mobile apps into one system, with the goal of letting agents complete cross-app, multi-step tasks in real phone environments.&lt;/p&gt;
&lt;p&gt;From the project structure, MobiAgent mainly consists of three parts: the MobiMind agent model series, the AgentRR recording-and-replay acceleration framework, and the MobiFlow benchmark. The paper abstract also emphasizes that accuracy and efficiency in real mobile tasks remain the main bottlenecks for current mobile agents, and MobiAgent is designed around those two problems.&lt;/p&gt;
&lt;h2 id=&#34;what-problem-it-solves&#34;&gt;What Problem It Solves
&lt;/h2&gt;&lt;p&gt;Mobile GUI agents are more troublesome than web or desktop automation. They need to understand screenshots, identify controls, decide the next action, and then use ADB or a mobile runtime to tap, type, go back, and switch apps. Real tasks are often not one operation inside one app, but a continuous flow across search, shopping, social, payment, maps, and other apps.&lt;/p&gt;
&lt;p&gt;MobiAgent systematizes these pieces:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;MobiMind handles task planning, decision-making, and interface localization.&lt;/li&gt;
&lt;li&gt;The runner connects to the phone, executes predefined tasks through ADB, and records traces.&lt;/li&gt;
&lt;li&gt;AgentRR reuses successful action sequences to reduce reasoning and operation cost for repeated tasks.&lt;/li&gt;
&lt;li&gt;MobiFlow evaluates task completion in real mobile scenarios.&lt;/li&gt;
&lt;li&gt;Data collection, annotation, and processing tools lower the cost of building mobile GUI task data.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This makes it more like a mobile-agent experimentation platform than a model project that can only run demos.&lt;/p&gt;
&lt;h2 id=&#34;recent-updates-worth-watching&#34;&gt;Recent Updates Worth Watching
&lt;/h2&gt;&lt;p&gt;The README shows that MobiAgent was open sourced in August 2025 and then continued to fill in models, runner, memory system, and on-device execution capability. From December 2025, the project supported pure on-device inference on phones and released a unified GUI agent runner that can be configured with MobiAgent, UI-TARS, AutoGLM, Qwen-VL, Gemini, and other models.&lt;/p&gt;
&lt;p&gt;By March 2026, the project had also released the GUI-based mobile &amp;ldquo;claw&amp;rdquo; MobiClaw and the new MobiMind-1.5-4B model. This suggests that it is not just reproducing a paper, but continuing to push mobile execution, model capability, and operation tooling toward a more product-like direction.&lt;/p&gt;
&lt;h2 id=&#34;memory-is-a-key-patch&#34;&gt;Memory Is a Key Patch
&lt;/h2&gt;&lt;p&gt;MobiAgent supports user profile memory, experience memory, and action memory. User profile memory gives planning preference context; experience memory retrieves execution experience from similar tasks; action memory uses AgentRR to cache and reuse successful action sequences.&lt;/p&gt;
&lt;p&gt;This matters because phone tasks are naturally repetitive. Users often search products in the same app, open fixed contacts, or fill information on particular pages. If the agent has to inspect the screen, plan, and tap from scratch every time, the cost is high and errors are likely. Memory can preserve part of the &amp;ldquo;learned flow&amp;rdquo;, making later tasks faster and more stable.&lt;/p&gt;
&lt;p&gt;Memory also creates governance questions. User preferences, task history, app paths, and action traces may contain sensitive information. In real deployments, the system needs to define what enters memory, how long it is stored, how it can be deleted, and whether the model may reuse that context across tasks.&lt;/p&gt;
&lt;h2 id=&#34;who-should-follow-it&#34;&gt;Who Should Follow It
&lt;/h2&gt;&lt;p&gt;If you only want a ready-made phone automation app, MobiAgent is still more of a research and engineering framework. It requires model services, mobile devices, ADB, dependencies, and task files, so a full run has a real setup cost.&lt;/p&gt;
&lt;p&gt;But if you care about mobile GUI agents, on-device agents, multi-model runners, task-trace reuse, or agent evaluation, MobiAgent is worth tracking. It places models, execution, evaluation, and data pipelines together, which helps researchers and developers see the real bottlenecks of mobile agents more completely.&lt;/p&gt;
&lt;h2 id=&#34;my-take&#34;&gt;My Take
&lt;/h2&gt;&lt;p&gt;MobiAgent matters not because it publishes one more GUI agent, but because it pushes phone agents beyond the single ability of &amp;ldquo;look at a screenshot and tap a button&amp;rdquo; into a framework that can be trained, executed, evaluated, and accelerated.&lt;/p&gt;
&lt;p&gt;Mobile is a scenario agents cannot easily avoid. Many personal tasks happen inside apps rather than standardized web pages or APIs. Whoever can reliably understand phone interfaces, execute cross-app tasks, reuse experience, and control privacy risks will be closer to a truly usable personal agent.&lt;/p&gt;
&lt;p&gt;MobiAgent has not solved all of these problems yet, but it provides a fairly complete open source starting point. In the short term, it is suitable for mobile-agent research and experimentation; in the long term, frameworks like this may become an important connection layer among mobile operating systems, personal assistants, and automation tools.&lt;/p&gt;
&lt;p&gt;Project link: &lt;a class=&#34;link&#34; href=&#34;https://github.com/IPADS-SAI/MobiAgent&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;IPADS-SAI/MobiAgent&lt;/a&gt;&lt;br&gt;
Paper link: &lt;a class=&#34;link&#34; href=&#34;https://arxiv.org/abs/2509.00531&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;MobiAgent: A Systematic Framework for Customizable Mobile Agents&lt;/a&gt;&lt;/p&gt;
</description>
        </item>
        
    </channel>
</rss>
