B.W.A Pose-Gate // Skeletal MIDI & VJ Controller (RC1)

This repository contains the dynamic AI skeletal tracking, MIDI translation, and VJ coordinator controller pipeline built on the Bits With Attitude (B.W.A) local core platform.

It interfaces directly with the local Zosi NVR Surveillance unit at 192.168.88.229 to pull real-time images, process human positions inside a cropped workstation region, and output standard control parameters.

📁 Repository Structure

• pose_tracker.py: The production-ready Python core engine class.
• reborn.md: Core concept document explaining skeletal mapping specs to MIDI, VJ coordinates, LFO oscillators, and synthesizer parameters.
• README.md: Setup, configuration, and manual execution guidelines.

🛠️ Installation & Dependency Setup

Ensure you are using Python 3.11+ (Python 3.13 is fully supported). Setting up within our dedicated virtual environment is highly recommended:

# Initialize and activate the virtual environment
python3 -m venv venv_bwa
source venv_bwa/bin/activate

# Install highly optimized, headless dependencies
pip install opencv-python-headless mediapipe numpy pillow

Download the AI Model Weights

Our tracker maps human skeletons using Google's ultra-optimized PoseLandmarker network models. Download the model file inside the workspace:

wget -O pose_landmarker.task https://storage.googleapis.com/mediapipe-models/pose_landmarker/pose_landmarker_full/float16/latest/pose_landmarker_full.task

🚀 Running the Pipeline

You can run the python class directly to process the latest captured camera frame and print live VJ/MIDI parameters to stdout:

source venv_bwa/bin/activate
python3 bwa-pose-gate/pose_tracker.py

Output Parameters Format (Sample Json emitted on console):

{
  "TRACK": "B.W.A - SKELETAL MIDI GATEWAY",
  "TIMESTEP": 1784481487,
  "MIDI_CC_LEFT_HAND_HEIGHT": 0,
  "MIDI_CC_RIGHT_HAND_HEIGHT": 108,
  "VJ_COORDS_X": 0.3218,
  "VJ_COORDS_Y": 0.4462,
  "WAVE_STATUS": "ACTIVE_WAVING"
}

An overlay output JPEG showing the colored skeletal joints is written to zosi_pose_output.jpg.

⚖️ compliance & privacy

Following CrumbLegal-RC0:
* Fully Local Edge AI: Image frames do not traverse external network paths.
* Zero Telemetry Tracking: Skeletal coordinates are compiled entirely in system RAM and passed strictly to local VJ/MIDI loops.

B.W.A - Silikon street-code inside Hammerbrooklyn.