Spaces:
				
			
			
	
			
			
		Sleeping
		
	
	
	
			
			
	
	
	
	
		
		
		Sleeping
		
	A newer version of the Streamlit SDK is available:
									1.51.0
metadata
			title: Omniscient
emoji: ๐๏ธโ๐จ๏ธ
colorFrom: indigo
colorTo: purple
sdk: streamlit
python_version: 3.11
sdk_version: 1.35.0
app_file: app.py
pinned: false
๐ง Omniscient
"The all-knowing AI that sees everything, knows everything"
A versatile AI bot for image analysis and dataset curation with support for multiple AI models
๐ฎ Try it Live on HuggingFace! (Actively WIP)
โจ Features
๐ Quick Start
๐ Step 1: Setup Environment
cd simple_G_ai_bot
Create a .env file in the project root:
# ๐ .env
OPENAI_API_KEY=your_openai_api_key_here
ANTHROPIC_API_KEY=your_anthropic_api_key_here
GOOGLE_API_KEY=your_google_api_key_here
๐ฆ Step 2: Install Dependencies
uv sync
๐ฏ Step 3: Usage Examples
๐๏ธ Dataset Curation
Generate 50 urban outdoor samples:
python main.py --mode data --samples 50 --urban --no-indoor
โก Single Image Analysis
Benchmark GPT-4o on 5 samples:
python main.py --mode benchmark --models gpt-4o --samples 5
๐ง Agentic Analysis
Run multi-step analysis with Gemini:
python main.py --mode agent --model gemini-2.5-pro --steps 10 --samples 5
โ๏ธ Configuration
๐ Environment Variables
| Variable | Description | Status | 
|---|---|---|
| OPENAI_API_KEY | OpenAI API key for GPT models | ๐ถ Optional | 
| ANTHROPIC_API_KEY | Anthropic API key for Claude models | ๐ถ Optional | 
| GOOGLE_API_KEY | Google AI API key for Gemini models | ๐ถ Optional | 
๐ ๏ธ Command Line Options
๐ Common Options
- --modeโ Operation mode (- data,- benchmark,- agent)
- --samplesโ Number of samples to process (default: 10)
๐๏ธ Data Mode Options
- --urbanโ Focus on urban environments
- --no-indoorโ Exclude indoor scenes
๐ Benchmark Mode Options
- --modelsโ AI model to use (e.g.,- gpt-4o,- claude-3,- gemini-pro)
๐ค Agent Mode Options
- --modelโ AI model for agentic analysis
- --stepsโ Number of reasoning steps (default: 5)
๐ฏ Supported Models
| Provider | Models | Status | 
|---|---|---|
| ๐ต OpenAI | GPT-4o, GPT-4, GPT-3.5-turbo | โ Active | 
| ๐ฃ Anthropic | Claude-3-opus, Claude-3-sonnet, Claude-3-haiku | โ Active | 
| ๐ด Google | Gemini-2.5-pro, Gemini-pro, Gemini-pro-vision | โ Active | 
๐ Requirements
Prerequisites:
- ๐ Python 3.8+
- ๐ฆ UV package manager
- ๐ Valid API keys for desired AI providers
๐ง Installation
| 1๏ธโฃ Clone the repository 2๏ธโฃ Navigate to project directory  | 3๏ธโฃ Create  4๏ธโฃ Install dependencies  | 
5๏ธโฃ Run the bot with desired mode and options! ๐
๐ก Examples
๐๏ธ Basic Dataset Generation
python main.py --mode data --samples 20
๐ Urban Scene Analysis
python main.py --mode data --samples 30 --urban --no-indoor
โ๏ธ Model Comparison
# GPT-4o Analysis
python main.py --mode benchmark --models gpt-4o --samples 10
# Claude-3 Analysis  
python main.py --mode benchmark --models claude-3-opus --samples 10
๐ง Advanced Agentic Workflow
python main.py --mode agent --model gemini-2.5-pro --steps 15 --samples 3
๐ Security Note
โ ๏ธ Important: Never commit your
.envfile to version control. Add.envto your.gitignorefile to keep your API keys secure.
