Capture Screen - Poppenspel-Advies/forget-me-not-mobile-app-ai GitHub Wiki
π‘ ForgetMeNot AIβ’ β Capture Screen
Capture the Signal. Analyze the Context. Preserve the Memory.
The Capture screen is the multimodal input gateway of ForgetMeNot AIβ’.
It allows the user to introduce a real-world signal into the application through different forms of input. The captured information is then processed through Gemini AI analysis, transformed into structured contextual information, and stored in the user's Firebase database.
The Capture architecture has two independent dimensions:
ποΈ Three Capture Methods
- π Note / Text
- πΌοΈ Image
- ποΈ Voice-Over β Coming Soon
π·οΈ Three Signal Tags
- π€ People
- π Places
- π¦ Things
Any capture method can be associated with any of the three signal tags.
πΈ Capture Screen

The Capture screen gives the user a direct interface for introducing contextual information into ForgetMeNot AI.
The user can provide a written signal, an image, or, in the planned future release, a voice signal.
The captured information then enters the Gemini intelligence pipeline.
USER
β
βΌ
CAPTURE
β
βββ π NOTE / TEXT
βββ πΌοΈ IMAGE
βββ ποΈ VOICE β COMING SOON
β
βΌ
SIGNAL TAG
β
βββ π€ PEOPLE
βββ π PLACES
βββ π¦ THINGS
β
βΌ
GEMINI AI ANALYSIS
β
βΌ
STRUCTURED SIGNAL
β
βΌ
FIREBASE DATABASE
β
βΌ
MEMORY
π§© Capture Method vs. Signal Type
It is important to distinguish between how the user provides information and what the information is about.
Capture Method = How the signal enters the application
| Method | Description | Status |
|---|---|---|
| π Note / Text | User types a signal manually | Available |
| πΌοΈ Image | User provides a visual signal | Available |
| ποΈ Voice-Over | User provides a spoken signal | Coming Soon |
Signal Tag = What the signal represents
| Tag | Description |
|---|---|
| π€ PEOPLE | Person or relationship-related context |
| π PLACES | Location or destination-related context |
| π¦ THINGS | Object, task, activity, or other contextual information |
Therefore:
CAPTURE METHOD
β
ββββββββββββββββΌβββββββββββββββ
β β β
βΌ βΌ βΌ
π TEXT πΌοΈ IMAGE ποΈ VOICE
β β β
ββββββββββββββββΌβββββββββββββββ
β
βΌ
SIGNAL TAG
β
ββββββββββββββββΌβββββββββββββββ
β β β
βΌ βΌ βΌ
π€ PEOPLE π PLACES π¦ THINGS
A note can therefore be about a person, place, or thing.
An image can also represent a person, place, or thing.
The planned Voice-Over capability will similarly support People, Places, and Things.
π Capture Method 1 β Note / Text
The first Capture method allows the user to manually enter a note or text signal.
The information may be a simple observation, reminder, task, intention, event, person-related item, location, object, or other contextual information.
Example
"I need to take my passport when I leave for the airport tomorrow."
The user's original text is the raw signal.
At this point, the application has the user's statement, but the intelligence layer has not yet converted it into its structured contextual representation.
RAW USER INPUT
β
"I need to take my passport
when I leave for the airport tomorrow."
β
GEMINI ANALYSIS
πΌοΈ Capture Method 2 β Image
The second Capture method allows the user to provide an image.
The image becomes a multimodal signal that can contain contextual information that is not explicitly typed by the user.
For example, an image could represent:
- π€ a person
- π a location
- π¦ an object
- a document
- an item that needs to be remembered
- visual contextual information
The image enters the Gemini multimodal analysis pipeline.
IMAGE
β
GEMINI VISUAL / CONTEXTUAL ANALYSIS
β
STRUCTURED SIGNAL
ποΈ Capture Method 3 β Voice-Over
Status: Coming Soon
Voice-Over is planned as the third Capture method.
The purpose is to allow a user to communicate a signal naturally through speech rather than typing it or providing an image.
The planned model is:
ποΈ USER VOICE
β
VOICE SIGNAL
β
GEMINI ANALYSIS
β
STRUCTURED CONTEXT
β
FIREBASE
Voice-Over will be designed around the same three signal categories:
ποΈ VOICE
β
βββ π€ PEOPLE
βββ π PLACES
βββ π¦ THINGS
π·οΈ The Three Signal Tags
π€ PEOPLE
The People tag represents information connected with a person or people.
Examples may include:
- Someone the user needs to contact
- Someone the user needs to meet
- A person connected with a task
- A person associated with an event
- A person the user wants to remember
A signal can be captured as text, image, or eventually Voice-Over.
π PLACES
The Places tag represents location-related information.
Examples may include:
- A destination
- Meeting location
- Office
- Airport
- Restaurant
- Travel destination
- Place associated with an upcoming activity
Again, the signal can originate from text, image, or Voice-Over.
π¦ THINGS
The Things tag represents objects, tasks, activities, belongings, or other contextual items.
Examples may include:
- Passport
- Keys
- Documents
- Shopping items
- Equipment
- An unfinished task
- Something that needs to be taken, prepared, completed, or remembered
π§ Gemini AI Analysis
The Gemini AI analysis layer is the central intelligence stage between the user's raw Capture input and persistent Firebase storage.
The user does not simply store an unprocessed note or image.
The captured signal first enters the AI analysis process.
USER CAPTURE
β
βΌ
βββββββββββββββββββββββ
β RAW SIGNAL β
β β
β π Text β
β πΌοΈ Image β
β ποΈ Voice β Soon β
ββββββββββββ¬βββββββββββ
β
βΌ
βββββββββββββββββββββββ
β GEMINI AI β
β ANALYSIS β
ββββββββββββ¬βββββββββββ
β
βΌ
βββββββββββββββββββββββ
β CONTEXTUAL SIGNAL β
β STRUCTURE β
ββββββββββββ¬βββββββββββ
β
βΌ
βββββββββββββββββββββββ
β FIREBASE DB β
βββββββββββββββββββββββ
Gemini provides the application's interpretation layer for the captured information.
π What Happens During Gemini Analysis?
The exact output depends on the information provided by the user, but conceptually the analysis transforms the raw signal into a more structured contextual representation.
The analysis can involve understanding elements such as:
1. Signal Meaning
What is the user communicating?
"I need to take my passport tomorrow."
The system can interpret the statement as information concerning an item that the user needs to remember.
2. Signal Category
The information can be associated with the application's signal taxonomy:
π¦ THINGS
because the signal concerns a physical item.
3. Context
The analysis can identify the surrounding contextual information contained within the user's signal.
For example:
THING
β Passport
ACTION
β Take / carry
TEMPORAL CONTEXT
β Tomorrow
USER INTENTION
β Remember to take the item
4. Relevant Relationships
The signal may contain relationships between different contextual elements.
For example:
PASSPORT
β
βββ belongs to β THINGS
βββ action β TAKE
βββ context β LEAVING / TRAVEL
5. Structured Signal
The raw information can then be represented as a structured ForgetMeNot AI signal.
Conceptually:
RAW SIGNAL
β
UNDERSTAND
β
CLASSIFY
β
EXTRACT CONTEXT
β
STRUCTURE
β
STORE
The important transition is:
Raw human input β AI-understood contextual signal
π§ Example β Note β Gemini Analysis
Suppose the user enters:
"I need to take my passport when I leave
for the airport tomorrow."
The Capture pipeline can be represented as:
βββββββββββββββββββββββββββββββββββββββ
β RAW USER NOTE β
β β
β "I need to take my passport β
β when I leave for the airport β
β tomorrow." β
ββββββββββββββββββββ¬βββββββββββββββββββ
β
GEMINI AI
β
βββββββββββββββββββββββββββββββββββββββ
β ANALYZED CONTEXT β
β β
β Signal: Passport β
β Category: THINGS β
β Action: Take / Carry β
β Context: Airport / Travel β
β Time Context: Tomorrow β
β Intent: Remember before departure β
ββββββββββββββββββββ¬βββββββββββββββββββ
β
STRUCTURED SIGNAL
β
FIREBASE DB
This illustrates how ForgetMeNot AI moves from a simple human statement toward a structured contextual memory.
πΌοΈ Example β Image β Gemini Analysis
An image can follow the same overall architecture.
ββββββββββββββββββββββββββββ
β IMAGE β
ββββββββββββββ¬ββββββββββββββ
β
ββββββββββββββββββββββββββββ
β GEMINI AI β
β MULTIMODAL ANALYSIS β
ββββββββββββββ¬ββββββββββββββ
β
ββββββββββββββββββββββββββββ
β CONTEXTUAL INTERPRETATIONβ
β β
β What is visible? β
β What does it represent? β
β Which signal category? β
β What context is relevant?β
ββββββββββββββ¬ββββββββββββββ
β
ββββββββββββββββββββββββββββ
β STRUCTURED SIGNAL β
ββββββββββββββ¬ββββββββββββββ
β
ββββββββββββββββββββββββββββ
β FIREBASE DB β
ββββββββββββββββββββββββββββ
The image therefore becomes part of the same persistent signal architecture as a text-based capture.
πΈ The Three Wiki Screenshots
The Capture page uses three screenshots to demonstrate representative states of the Capture functionality.
These screenshots should not be interpreted as three separate signal categories.
They demonstrate different Capture / Analysis states.
Screenshot 1 β Note Before Gemini Analysis

This screenshot represents the user providing a Note / Text signal before Gemini analysis.
At this stage:
USER
β
NOTE / TEXT
β
RAW SIGNAL
β
WAITING FOR ANALYSIS
The information shown represents the user's original input.
Screenshot 2 β Note With Gemini Analysis

This screenshot represents the same general Capture workflow after the signal has gone through Gemini AI analysis.
The application can now work with the analyzed contextual representation rather than only the user's original text.
NOTE / TEXT
β
GEMINI AI
β
ANALYSIS
β
CONTEXT
β
STRUCTURED SIGNAL
β
FIREBASE
This is the key transition from capture to intelligent memory.
Screenshot 3 β Image With Gemini Analysis

This screenshot demonstrates an image-based signal after Gemini analysis.
The image is treated as a multimodal input and processed through the same intelligence architecture.
IMAGE
β
GEMINI MULTIMODAL ANALYSIS
β
CONTEXTUAL UNDERSTANDING
β
STRUCTURED SIGNAL
β
FIREBASE
The Capture architecture therefore supports both textual and visual signals while maintaining the same underlying storage and memory lifecycle.
βοΈ Firebase Database Storage
After Gemini analysis, the analyzed signal is stored in the Firebase database for the authenticated user.
The complete storage pipeline is:
USER
β
CAPTURE
β
GEMINI AI ANALYSIS
β
STRUCTURED SIGNAL
β
FIREBASE DATABASE
β
USER MEMORY
Firebase becomes the persistent layer containing the user's analyzed signals.
The stored information can subsequently participate in the broader ForgetMeNot AI contextual memory system.
π§ Capture β Gemini β Firebase β Memory
The relationship between the Capture and Memory screens is fundamental to the application.
βββββββββββββββββββ
β CAPTURE β
β β
β Note / Image / β
β Voice β Soon β
ββββββββββ¬βββββββββ
β
βββββββββββββββββββ
β GEMINI AI β
β ANALYSIS β
ββββββββββ¬βββββββββ
β
βββββββββββββββββββ
β STRUCTURED β
β SIGNAL β
ββββββββββ¬βββββββββ
β
βββββββββββββββββββ
β FIREBASE DB β
ββββββββββ¬βββββββββ
β
βββββββββββββββββββ
β MEMORY β
β β
β View / Edit / β
β Delete β
βββββββββββββββββββ
βοΈ User Control Through Memory
Once the analyzed signal has been stored in Firebase, the user can access it through the Memory screen.
The user can:
ποΈ View
Review the stored contextual signal.
βοΈ Edit
Modify information associated with the stored signal.
ποΈ Delete
Remove a stored signal from the user's memory collection.
Therefore, the Capture process does not end with Firebase storage.
It continues into a user-controlled memory lifecycle:
CAPTURE
β
ANALYSIS
β
STORAGE
β
MEMORY
βββ VIEW
βββ EDIT
βββ DELETE
π Complete ForgetMeNot Capture Lifecycle
USER
β
βΌ
ββββββββββββββββββ
β CAPTURE β
βββββββββ¬βββββββββ
β
ββββββββββββββββΌβββββββββββββββ
βΌ βΌ βΌ
π NOTE/TEXT πΌοΈ IMAGE ποΈ VOICE
COMING SOON
β β β
ββββββββββββββββΌβββββββββββββββ
βΌ
ββββββββββββββββ
β SIGNAL TAG β
ββββββββ¬ββββββββ
β
βββββββββββββΌββββββββββββ
βΌ βΌ βΌ
π€ PEOPLE π PLACES π¦ THINGS
β β β
βββββββββββββΌββββββββββββ
βΌ
ββββββββββββββββ
β GEMINI AI β
β ANALYSIS β
ββββββββ¬ββββββββ
βΌ
ββββββββββββββββ
β STRUCTURED β
β SIGNAL β
ββββββββ¬ββββββββ
βΌ
ββββββββββββββββ
β FIREBASE DB β
ββββββββ¬ββββββββ
βΌ
ββββββββββββββββ
β MEMORY β
ββββββββ¬ββββββββ
β
βββββββββΌββββββββ
βΌ βΌ βΌ
ποΈ VIEW βοΈ EDIT ποΈ DELETE
π Capture Architecture at a Glance
| Layer | Function |
|---|---|
| π Note / Text | User enters a written signal |
| πΌοΈ Image | User provides a visual signal |
| ποΈ Voice-Over | Planned spoken signal input |
| π€ People | Person-related signal classification |
| π Places | Location-related signal classification |
| π¦ Things | Object/task/context signal classification |
| π§ Gemini AI | Analyzes the captured signal |
| π Context Analysis | Interprets relevant information within the signal |
| π§© Structured Signal | Converts analyzed information into application-ready context |
| βοΈ Firebase DB | Stores analyzed signals for the authenticated user |
| π§ Memory | Displays stored signals |
| βοΈ Edit | User can modify a stored signal |
| ποΈ Delete | User can remove a stored signal |
π The Intelligence Behind Capture
The Capture screen is more than a traditional note-taking interface.
It establishes the first connection between:
Human observation β Multimodal input β AI interpretation β Contextual memory
The user provides the information in the most natural available form.
The application then moves that information through the intelligence pipeline:
Capture β Analyze β Structure β Store β Remember
With three capture methods:
π Text Β· πΌοΈ Image Β· ποΈ Voice
and three signal dimensions:
π€ People Β· π Places Β· π¦ Things
the Capture screen forms the foundation of the ForgetMeNot AI predictive memory architecture.
π« Core Principle
The user creates the signal. Gemini analyzes the signal. Firebase preserves the signal. Memory gives the user control over the signal.