posted in Selfhosted

chaospatterns@chaospatterns@lemmy.world
edited

[AIT] Birdnet-go: Self-hosted realtime soundscape analyser for birds, bats and other wildlife

Birdnet-go is a real-time sound analyzer that detects bird species. It can take in audio from microphones. I set mine up to stream audio from my security cameras that I already had installed. There’s even a Home Assistant App, if you’re using it.

I live in a more suburban/semi-urban environment, but was really surprised to so many different bird species.

github.com/tphakala/birdnet-go/
Self-hosted realtime soundscape analyser for birds, bats and other wildlife. Multi-model local AI inference, runs 24/7 on a Raspberry Pi. - tphakala/birdnet-goGitHubGitHub - tphakala/birdnet-go: Self-hosted realtime soundscape analyser for birds, bats and other wildlife. Multi-model local AI inference, runs 24/7 on a Raspberry Pi.Self-hosted realtime soundscape analyser for birds, bats and other wildlife. Multi-model local AI inference, runs 24/7 on a Raspberry Pi. - tphakala/birdnet-go
A_norny_mousse@A_norny_mousse@piefed.zip
edited

Replying to an earlier post

Let this post be the one to ask a question that’s been bothering me (not a coder):

Multi-model local AI inference, runs 24/7 on a Raspberry Pi.

This and similar claims in other software suggest - to me - that the AI is running locally on the raspi, no need to exchange data with sites providing AI APIs or whatever.

I struggle to believe that this is possible, let alone on a raspi.

So, how “local” ar the AIs that help more and more software with various tasks?

Is “local AI” some sort of selling point that is often false or deliberately misleading? “Localwashing”?

edit: thanks for all the answers, this has been enlightening.

pyr0ball@pyr0ball@lemmy.dbzer0.com
edited

Replying to @⁨A_norny_mousse@piefed.zip⁩

LLM and VLM are generally the type of model that needs a ton of resources to run. Birdnet uses an audio classification model, but there are dozens of types of models.

I’m building specialized task-focused pipelines which keep the memory footprint small for self-hosted users, and I’m working on a unified framework too make building other pipelines and applications much easier: docs.circuitforge.tech

If you give me some details on what you’re after I might be able to find you some projects or at least clarify keywords

Edit: an example of how efficient these can get, I have a little ESP32-driven waveshare display running an ONNX wake-word detection model which is absolutely nuts. 4mb psram and a dual-core 240mhz cpu and its only job is handling “hey Mycroft” and establishing a proper speech-to-text connection with my server downstairs

docs.circuitforge.techCircuitForge DocsDocumentation for CircuitForge tools — Tools for the tasks the system made hard on purpose.