Bugs found in Answer.AI – Your AI tutor for iOS
Answer.AI is a tool designed to simplify your interaction with data through a user-friendly interface. As a result, people without a background in tech can use it easily and get precise answers to complex queries.
The tool leverages AI and ML to obtain answers and provide them in an easy-to-understand manner. Therefore, the decision-making process and data output format are as important for its performance as the AI model powering the research.
Our team at QAwerk tested this app and discovered a few issues that can impact its performance. Keep reading to find out what they are.
Chatting: user cannot ask multi-sentence questions as previous recording is cleared after short pause
Severity:
Critical
Precondition:
- Log in to the app.
- Make sure you are allowed to access your microphone.
Steps to Reproduce:
- In the bottom menu, click on the ‘Chat’ icon.
- Tap on the microphone in the ‘Write your message’ field.
- Tap to start talking.
- Ask a question that consists of 2 sentences.
Environment:
iPhone 14 Pro Max, iOS 18.6.2
Actual Result:
The app clears the first sentence and gives an answer only to the last one.
Expected Result:
User asks a multi-sentence question and gets a relevant answer.
Chatting: AI returns ‘No relevant content detected’ for many questions containing images
Severity:
Critical
Precondition:
- Log in to the app.
- Make sure you have access to your media library.
Steps to Reproduce:
- In the bottom menu, click on the ‘Chat’ icon.
- Put a question into the ‘Write your message’ field, for example, ‘What city is that?’.
- Click on the plus icon in the ‘Write your message’ field.
- Attach a famous landmark, for example, the Eiffel Tower.
- Select a proper area on the image.
- Click on the ‘Solve’ button.
Environment:
iPhone 14 Pro Max, iOS 18.6.2
Actual Result:
AI returns ‘No relevant content detected’ result.
Expected Result:
AI returns a correct answer as its slogan is ‘Ask everything. Learn everything.’
Flashcards: answer options contain correct answer indicating need to improve creation logic
Severity:
Major
Precondition:
- Log in to the app.
- Prepare some materials (we used the Financial topic, in particular, stock market shares, for testing).
Steps to Reproduce:
- In the bottom menu, click on the ‘Camera’ icon.
- Swipe to ‘Flashcards’.
- Take a picture of the materials.
- Click on the ‘Solve’ button.
- Once the flashcards are generated, click on the ‘Check your flash card!’ text.
- Click the cards icon in the top-right corner.
- Click on the ‘Test’ button.
Environment:
iPhone 14 Pro Max, iOS 18.6.2
Actual Result:
Some flashcards’ answer options contain the obvious correct answer, which ruins the idea of the test.
Expected Result:
Answer options should not contain the obvious correct answer.
‘Follow us on TikTok’ button rewards user on click, even without actual follow
Severity:
Minor
Precondition:
Log in to the app.
Steps to Reproduce:
- In the bottom menu, click on the ‘Energy’ icon.
- Click on the ‘Follow us on TikTok’ button.
Environment:
iPhone 14 Pro Max, iOS 18.6.2
Actual Result:
The user gets rewarded without the TikTok follow registered.
This bug was also reproduced with ‘Instagram’ and ‘Join Our Discord’ options.
Expected Result:
The user should get rewarded after following the account on TikTok, or the text should be different.
The app is very helpful for studying, as it quickly provides answers from a photo of a task. I also like the flashcard feature for testing memory. The app is well-designed, though there’s still room for improvement.
