How to clone, install and run the "audiohealth" program

[Flat]

@clemens

I think the algorithm is not very robust. I would expect that a Bach prelude would lead to a “valid” output like swarm or active also and there is no error detection for “wrong” sounds. So it is always a good idea to trim files so that you do not have non-bee sound.

But let me emphasize this again: Detecting backround noise or other not bee based sound would be the job for an good algorithm. And even the output for bee sound I have seen 2017 was very fragile, see Analyze recordings from queen vs. queenless hives using “audiohealth” So I would not count on the ouput at all beside an experimental interest on the program.

Hi clemns,
There are now many more audio files available since 2017.
Nguyen Huu Du et al. (2020) Audio Beehive Monitoring Based on IoT-AI.pdf (782.6 KB)
Kulyukin V (2018) Toward_Audio_Beehive_Monitoring_Deep_Learning.pdf (2.6 MB)
Are there any plans to run the AudioHealth learning script again to develop a new classification strategy lr3.0 or redesign to cnn1.0.

Kind regards Paul
There are so many new and interesting AI applications being developed its never been a better time to be in bee keeping. Very exiting!

[Flat]

Hi Andreas,

I have tried the following functions on one .WAV file with mixed results.

1a, 1w  Power with              --audiofile , --wavfile
2a, 2w  Spectrogram with        --audiofile , --wavfile
3a, 3w  Analyzer with           --audiofile , --wavfile

1a. Power with --audiofile

$ audiohealth power --audiofile samples/PCM009.WAV --pngfile samples/PCM009audpwr.png
==================
Peaks by frequency
==================

==============
Peaks by power
==============

========
Analysis
========
Colony has no activity.
Reason: There is no activity around 250Hz.

1w. Power with --wavfile

$ audiohealth power --wavfile samples/PCM009.WAV --pngfile samples/PCM009wavpwr.png
==================
Peaks by frequency
==================
          93.75 Hz            190.13 RMS

==============
Peaks by power
==============
         190.13 RMS             93.75 Hz

========
Analysis
========
Colony has no activity.
Reason: There is no activity around 250Hz.

2a, Spectrogram with --audiofile

$ audiohealth spectrogram --audiofile samples/PCM009.WAV --pngfile samples/PCM009audspec.png
total time: 47.88s, samplerate: 24.00kHz

2w, Spectrogram with --wavfile

$ audiohealth spectrogram --wavfile samples/PCM009.WAV --pngfile samples/PCM009wavspec.png
Usage:
      audiohealth analyze --audiofile audiofile --analyzer /path/to/osbh-audioanalyzer [--strategy lr-2.1] [--debug] [--keep]
      audiohealth analyze --wavfile wavfile --analyzer /path/to/osbh-audioanalyzer [--strategy lr-2.1] [--debug]
      audiohealth analyze --datfile datfile --analyzer /path/to/osbh-audioanalyzer [--strategy lr-2.1] [--debug]
      audiohealth convert --audiofile audiofile --wavfile wavfile
      audiohealth spectrogram --audiofile audiofile --pngfile pngfile
      audiohealth power   --audiofile audiofile --pngfile pngfile
      audiohealth power   --wavfile wavfile     --pngfile pngfile
      audiohealth --version
      audiohealth (-h | --help)

3a, Analyzer with --audiofile

$ audiohealth analyze --audiofile samples/PCM009.WAV --analyzer tools/osbh-audioanalyzer/bin/test --strategy lr-2.1
Duration: 47.87206349206349s
File:     /tmp/tmpqsyb7a51.wav.dat
Strategy: lr-2.1

==================
Sequence of states
==================
missing_queen, swarm, swarm, swarm, collapsed, collapsed, collapsed, swarm, collapsed

===================
Compressed timeline
===================
  0s -  10s   missing_queen   =
 10s -  40s   swarm           ===
 40s -  70s   collapsed       ===
 70s -  80s   swarm           =
 80s -  90s   collapsed       =

==============
Total duration
==============
        40s   swarm           ====
        40s   collapsed       ====
        10s   missing_queen   =

======
Result
======
The most common events (i.e. the events with the highest total duration) are:

     The colony is mostly in »SWARM« state, which is going on for 40 seconds.
     Sometimes, the state oscillates to »COLLAPSED«, for 40 seconds in total.

==========
Disclaimer
==========
THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. NO LIABILITY FOR ANY DAMAGES WHATSOEVER.

3w. Analyzer with --wavfile

$ audiohealth analyze --wavfile samples/PCM009.WAV --analyzer tools/osbh-audioanalyzer/bin/test --strategy lr-2.1
Duration: 47.872s
File:     samples/PCM009.WAV.dat
Strategy: lr-2.1

==================
Sequence of states
==================
active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active, active

===================
Compressed timeline
===================
  0s - 360s   active          ====================================

==============
Total duration
==============
       360s   active          ====================================

======
Result
======
The most common events (i.e. the events with the highest total duration) are:

     The colony is mostly in »ACTIVE« state, which is going on for 360 seconds.

==========
Disclaimer
==========
THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. NO LIABILITY FOR ANY DAMAGES WHATSOEVER.

I’m not sure if the problem lies in the signal strength of the audio sample or the ability of lr-2.1 to discern.

Kind regards Paul

[clemens]

@Flat

Are there any plans to run the AudioHealth learning script again to develop a new classification strategy lr3.0 or redesign to cnn1.0.

As mentioned above. We do not have the OSBH learning script and it is closed source never published (afaik) from OSBH. So we would have to develop it new from scratch and also the matching analysing part. But I’m not so deep in the code perhaps @Andreas can add some insights what we have and what OSBH has closed and not public developed since 2017.