Maintained by Fadhila36

A high-performance, stateless, and resilient microservice for video and image compression. Built for Enterprise scale using Go, Redis, and S3.

• Smart Compression: Automatically detects input bitrate using ffprobe. Skips compression if input is already optimized (< 1500k bitrate) to prevent quality loss.
• Distributed Queue: Uses Redis (via Asynq) for reliable, persistent job queuing. Supports Dead Letter Queues and automatic Retries.
• Stateless Architecture: Processed files are uploaded to S3 (AWS, R2, MinIO) with Private ACLs. Local storage is ephemeral and immediately cleaned up.
• Secure Delivery: Webhooks deliver Presigned URLs (valid for 1 hour) instead of public links.
• Observability: Production-grade structured logging using uber-go/zap with traceable job_id.
• Security: API Key Authentication, Strict File Type Validation, and Rate Limiting.
• Graceful Shutdown: Ensures active jobs complete before server termination.

graph TD
    Client[Client App] -->|POST /api/compress| API[Fiber API Gateway]
    API -->|Validation & Auth| API
    API -->|Enqueue Job| Redis[(Redis Queue)]
    
    Worker[Go Worker] -->|Pull Task| Redis
    Worker -->|Fetch File| Disk[Ephemeral Temp Storage]
    Worker -->|Run FFprobe/FFmpeg| Disk
    
    Worker -->|Upload Result| S3[(AWS S3 / R2)]
    S3 -->|Generate Presigned URL| Worker
    
    Worker -->|POST Result + URL| Webhook[Client Webhook]
    Worker -->|Cleanup| Disk

• Go 1.18+
• Redis (Running instance)
• FFmpeg (Installed on host)
• S3-Compatible Storage (AWS, Cloudflare R2, MinIO)

Copy .env.example to .env and configure your credentials.

cp .env.example .env

# Install dependencies
go mod tidy

# Run server
go run main.go

docker build -t gocompress .
docker run -p 3000:3000 --env-file .env gocompress

Submit a video or image for compression.

Headers:

• X-Secret-Key: <Your API_SECRET>

Body (multipart/form-data):

• file: (Required) Video or Image file.
• webhook_url: (Required) Endpoint to receive the callback.

Response (202 Accepted):

{
  "status": "queued",
  "job_id": "550e8400-e29b-41d4-a716-446655440000"
}

Sent to webhook_url upon completion.

{
  "job_id": "550e8400-e29b-41d4-a716-446655440000",
  "status": "success",
  "download_url": "https://bucket.s3.region.amazonaws.com/file.mp4?signature=...",
  "original_size": 10485760,
  "compressed_size": 4500000
}

Note: download_url is a secure Presigned URL valid for 1 hour.

Contributions are welcome! Please feel free to submit a Pull Request.

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

This project stands on the shoulders of giants. Special thanks to:

• Go Fiber - Web Framework
• Hibiken Asynq - Distributed Queue
• Uber Zap - Structured Logging
• AWS SDK v2 - Cloud Storage
• FFmpeg - Video Processing

Distributed under the MIT License. See LICENSE for more information.

© 2025 Fadhila36