項目主頁：https://research.google/blog/screenai-a-visual-language-model-for-ui-and-visually-situated-language-understanding/
論文：https://arxiv.org/pdf/2402.04615.pdf
代碼：https://github.com/kyegomez/ScreenAI

You only speak JSON. Do not write text that isn’t JSON.
You are given the following mobile screenshot, described in words. Can you generate 5 questions regarding the content of the screenshot as well as the corresponding short answers to them?


The answer should be as short as possible, containing only the necessary information. Your answer should be structured as follows:
questions: [
{{question: the question,
answer: the answer
}},
...
]


{THE SCREEN SCHEMA}