{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Fish detection using Dynamic time warping and optimal transport\n", "In this example, we'll search for a short audio clip in a a longer recording. The sound we're looking for is stored in the file `fish_pattern1.wav` and the recording we're looking through is stored in `fish_data.wav`. The fiels are available on [google drive](https://drive.google.com/open?id=1f2c6AjS9EY-boa6dT1v5aJrEpUoh_mIZ). We start by loading some packages" ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "(ENV[\"PYTHON\"], ENV[\"JULIA_NUM_THREADS\"], ENV[\"IJULIA_DEBUG\"]) = (\"python3\", \"4\", \"false\")\n" ] }, { "data": { "text/plain": [ "(\"python3\", \"4\", \"false\")" ] }, "execution_count": 13, "metadata": {}, "output_type": "execute_result" } ], "source": [ "@show ENV[\"PYTHON\"], ENV[\"JULIA_NUM_THREADS\"], ENV[\"IJULIA_DEBUG\"]" ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [], "source": [ "using SpectralDistances, DynamicAxisWarping, DSP, TotalLeastSquares, WAV, LPVSpectral, Distances, Dates, Plots\n", "using DynamicAxisWarping: lastlength\n", "plotly()\n", "function seconds2ms(s)\n", " s = round(Int, s)\n", " h = s÷3600\n", " s -= 3600h\n", " m = s÷60\n", " s -= 60m\n", " \"$m:$s\"\n", "end\n", "default(xformatter=seconds2ms, colorbar=false)\n", "cd(@__DIR__)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We then set some parameters for the pre-processing. To cut down on processing time, we select a rather coarse resolution along both frequency and time axes. The radius `rad` is the maximum allowed time warping. Increasing this parameter makes the problem take longer time to solve." ] }, { "cell_type": "code", "execution_count": 15, "metadata": {}, "outputs": [], "source": [ "nfft = 256\n", "rad = 6 # This is the maximum allowed warping radius\n", "\n", "timevec(res) = range(0,stop=length(y)/fs, length=length(res))\n", "function n01(x) # Normalization for plotting\n", " ql = quantile(filter(isfinite,x), 0.001)\n", " x[x .< ql] .= ql\n", " x = x .- ql\n", " qu = quantile(filter(isfinite,x), 0.95)\n", " x[x .> qu] .= qu\n", " x ./= qu\n", " x\n", "end\n", "ff(x,n=10) = filtfilt(ones(n),[n],x)\n", "plotvecs(res) = timevec(res), n01(res);" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We're now ready to load the data and estimate some spectrograms. Here we take care to only estimate spectrograms for the frequencies that are improtant for the task, 200-550Hz." ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "data": { "text/html": [ " \n" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.plotly.v1+json": { "data": [ { "colorbar": { "title": "" }, "colorscale": [ [ 0, "rgba(0, 0, 4, 1.000)" ], [ 0.00392156862745098, "rgba(1, 0, 5, 1.000)" ], [ 0.00784313725490196, "rgba(1, 1, 6, 1.000)" ], [ 0.011764705882352941, "rgba(1, 1, 8, 1.000)" ], [ 0.01568627450980392, "rgba(2, 1, 10, 1.000)" ], [ 0.0196078431372549, "rgba(2, 2, 12, 1.000)" ], [ 0.023529411764705882, "rgba(2, 2, 14, 1.000)" ], [ 0.027450980392156862, "rgba(3, 2, 16, 1.000)" ], [ 0.03137254901960784, "rgba(4, 3, 18, 1.000)" ], [ 0.03529411764705882, "rgba(4, 3, 20, 1.000)" ], [ 0.0392156862745098, "rgba(5, 4, 23, 1.000)" ], [ 0.043137254901960784, "rgba(6, 4, 25, 1.000)" ], [ 0.047058823529411764, "rgba(7, 5, 27, 1.000)" ], [ 0.050980392156862744, "rgba(8, 5, 29, 1.000)" ], [ 0.054901960784313725, "rgba(9, 6, 31, 1.000)" ], [ 0.058823529411764705, "rgba(10, 7, 34, 1.000)" ], [ 0.06274509803921569, "rgba(11, 7, 36, 1.000)" ], [ 0.06666666666666667, "rgba(12, 8, 38, 1.000)" ], [ 0.07058823529411765, "rgba(13, 8, 41, 1.000)" ], [ 0.07450980392156863, "rgba(14, 9, 43, 1.000)" ], [ 0.0784313725490196, "rgba(16, 9, 45, 1.000)" ], [ 0.08235294117647059, "rgba(17, 10, 48, 1.000)" ], [ 0.08627450980392157, "rgba(18, 10, 50, 1.000)" ], [ 0.09019607843137255, "rgba(20, 11, 52, 1.000)" ], [ 0.09411764705882353, "rgba(21, 11, 55, 1.000)" ], [ 0.09803921568627451, "rgba(22, 11, 57, 1.000)" ], [ 0.10196078431372549, "rgba(24, 12, 60, 1.000)" ], [ 0.10588235294117647, "rgba(25, 12, 62, 1.000)" ], [ 0.10980392156862745, "rgba(27, 12, 65, 1.000)" ], [ 0.11372549019607843, "rgba(28, 12, 67, 1.000)" ], [ 0.11764705882352941, "rgba(30, 12, 69, 1.000)" ], [ 0.12156862745098039, "rgba(31, 12, 72, 1.000)" ], [ 0.12549019607843137, "rgba(33, 12, 74, 1.000)" ], [ 0.12941176470588237, "rgba(35, 12, 76, 1.000)" ], [ 0.13333333333333333, "rgba(36, 12, 79, 1.000)" ], [ 0.13725490196078433, "rgba(38, 12, 81, 1.000)" ], [ 0.1411764705882353, "rgba(40, 11, 83, 1.000)" ], [ 0.1450980392156863, "rgba(41, 11, 85, 1.000)" ], [ 0.14901960784313725, "rgba(43, 11, 87, 1.000)" ], [ 0.15294117647058825, "rgba(45, 11, 89, 1.000)" ], [ 0.1568627450980392, "rgba(47, 10, 91, 1.000)" ], [ 0.1607843137254902, "rgba(49, 10, 92, 1.000)" ], [ 0.16470588235294117, "rgba(50, 10, 94, 1.000)" ], [ 0.16862745098039217, "rgba(52, 10, 95, 1.000)" ], [ 0.17254901960784313, "rgba(54, 9, 97, 1.000)" ], [ 0.17647058823529413, "rgba(56, 9, 98, 1.000)" ], [ 0.1803921568627451, "rgba(57, 9, 99, 1.000)" ], [ 0.1843137254901961, "rgba(59, 9, 100, 1.000)" ], [ 0.18823529411764706, "rgba(61, 9, 101, 1.000)" ], [ 0.19215686274509805, "rgba(62, 9, 102, 1.000)" ], [ 0.19607843137254902, "rgba(64, 10, 103, 1.000)" ], [ 0.2, "rgba(66, 10, 104, 1.000)" ], [ 0.20392156862745098, "rgba(68, 10, 104, 1.000)" ], [ 0.20784313725490197, "rgba(69, 10, 105, 1.000)" ], [ 0.21176470588235294, "rgba(71, 11, 106, 1.000)" ], [ 0.21568627450980393, "rgba(73, 11, 106, 1.000)" ], [ 0.2196078431372549, "rgba(74, 12, 107, 1.000)" ], [ 0.2235294117647059, "rgba(76, 12, 107, 1.000)" ], [ 0.22745098039215686, "rgba(77, 13, 108, 1.000)" ], [ 0.23137254901960785, "rgba(79, 13, 108, 1.000)" ], [ 0.23529411764705882, "rgba(81, 14, 108, 1.000)" ], [ 0.23921568627450981, "rgba(82, 14, 109, 1.000)" ], [ 0.24313725490196078, "rgba(84, 15, 109, 1.000)" ], [ 0.24705882352941178, "rgba(85, 15, 109, 1.000)" ], [ 0.25098039215686274, "rgba(87, 16, 110, 1.000)" ], [ 0.2549019607843137, "rgba(89, 16, 110, 1.000)" ], [ 0.25882352941176473, "rgba(90, 17, 110, 1.000)" ], [ 0.2627450980392157, "rgba(92, 18, 110, 1.000)" ], [ 0.26666666666666666, "rgba(93, 18, 110, 1.000)" ], [ 0.27058823529411763, "rgba(95, 19, 110, 1.000)" ], [ 0.27450980392156865, "rgba(97, 19, 110, 1.000)" ], [ 0.2784313725490196, "rgba(98, 20, 110, 1.000)" ], [ 0.2823529411764706, "rgba(100, 21, 110, 1.000)" ], [ 0.28627450980392155, "rgba(101, 21, 110, 1.000)" ], [ 0.2901960784313726, "rgba(103, 22, 110, 1.000)" ], [ 0.29411764705882354, "rgba(105, 22, 110, 1.000)" ], [ 0.2980392156862745, "rgba(106, 23, 110, 1.000)" ], [ 0.30196078431372547, "rgba(108, 24, 110, 1.000)" ], [ 0.3058823529411765, "rgba(109, 24, 110, 1.000)" ], [ 0.30980392156862746, "rgba(111, 25, 110, 1.000)" ], [ 0.3137254901960784, "rgba(113, 25, 110, 1.000)" ], [ 0.3176470588235294, "rgba(114, 26, 110, 1.000)" ], [ 0.3215686274509804, "rgba(116, 26, 110, 1.000)" ], [ 0.3254901960784314, "rgba(117, 27, 110, 1.000)" ], [ 0.32941176470588235, "rgba(119, 28, 109, 1.000)" ], [ 0.3333333333333333, "rgba(120, 28, 109, 1.000)" ], [ 0.33725490196078434, "rgba(122, 29, 109, 1.000)" ], [ 0.3411764705882353, "rgba(124, 29, 109, 1.000)" ], [ 0.34509803921568627, "rgba(125, 30, 109, 1.000)" ], [ 0.34901960784313724, "rgba(127, 30, 108, 1.000)" ], [ 0.35294117647058826, "rgba(128, 31, 108, 1.000)" ], [ 0.3568627450980392, "rgba(130, 32, 108, 1.000)" ], [ 0.3607843137254902, "rgba(132, 32, 107, 1.000)" ], [ 0.36470588235294116, "rgba(133, 33, 107, 1.000)" ], [ 0.3686274509803922, "rgba(135, 33, 107, 1.000)" ], [ 0.37254901960784315, "rgba(136, 34, 106, 1.000)" ], [ 0.3764705882352941, "rgba(138, 34, 106, 1.000)" ], [ 0.3803921568627451, "rgba(140, 35, 105, 1.000)" ], [ 0.3843137254901961, "rgba(141, 35, 105, 1.000)" ], [ 0.38823529411764707, "rgba(143, 36, 105, 1.000)" ], [ 0.39215686274509803, "rgba(144, 37, 104, 1.000)" ], [ 0.396078431372549, "rgba(146, 37, 104, 1.000)" ], [ 0.4, "rgba(147, 38, 103, 1.000)" ], [ 0.403921568627451, "rgba(149, 38, 103, 1.000)" ], [ 0.40784313725490196, "rgba(151, 39, 102, 1.000)" ], [ 0.4117647058823529, "rgba(152, 39, 102, 1.000)" ], [ 0.41568627450980394, "rgba(154, 40, 101, 1.000)" ], [ 0.4196078431372549, "rgba(155, 41, 100, 1.000)" ], [ 0.4235294117647059, "rgba(157, 41, 100, 1.000)" ], [ 0.42745098039215684, "rgba(159, 42, 99, 1.000)" ], [ 0.43137254901960786, "rgba(160, 42, 99, 1.000)" ], [ 0.43529411764705883, "rgba(162, 43, 98, 1.000)" ], [ 0.4392156862745098, "rgba(163, 44, 97, 1.000)" ], [ 0.44313725490196076, "rgba(165, 44, 96, 1.000)" ], [ 0.4470588235294118, "rgba(166, 45, 96, 1.000)" ], [ 0.45098039215686275, "rgba(168, 46, 95, 1.000)" ], [ 0.4549019607843137, "rgba(169, 46, 94, 1.000)" ], [ 0.4588235294117647, "rgba(171, 47, 94, 1.000)" ], [ 0.4627450980392157, "rgba(173, 48, 93, 1.000)" ], [ 0.4666666666666667, "rgba(174, 48, 92, 1.000)" ], [ 0.47058823529411764, "rgba(176, 49, 91, 1.000)" ], [ 0.4745098039215686, "rgba(177, 50, 90, 1.000)" ], [ 0.47843137254901963, "rgba(179, 50, 90, 1.000)" ], [ 0.4823529411764706, "rgba(180, 51, 89, 1.000)" ], [ 0.48627450980392156, "rgba(182, 52, 88, 1.000)" ], [ 0.49019607843137253, "rgba(183, 53, 87, 1.000)" ], [ 0.49411764705882355, "rgba(185, 53, 86, 1.000)" ], [ 0.4980392156862745, "rgba(186, 54, 85, 1.000)" ], [ 0.5019607843137255, "rgba(188, 55, 84, 1.000)" ], [ 0.5058823529411764, "rgba(189, 56, 83, 1.000)" ], [ 0.5098039215686274, "rgba(191, 57, 82, 1.000)" ], [ 0.5137254901960784, "rgba(192, 58, 81, 1.000)" ], [ 0.5176470588235295, "rgba(193, 58, 80, 1.000)" ], [ 0.5215686274509804, "rgba(195, 59, 79, 1.000)" ], [ 0.5254901960784314, "rgba(196, 60, 78, 1.000)" ], [ 0.5294117647058824, "rgba(198, 61, 77, 1.000)" ], [ 0.5333333333333333, "rgba(199, 62, 76, 1.000)" ], [ 0.5372549019607843, "rgba(200, 63, 75, 1.000)" ], [ 0.5411764705882353, "rgba(202, 64, 74, 1.000)" ], [ 0.5450980392156862, "rgba(203, 65, 73, 1.000)" ], [ 0.5490196078431373, "rgba(204, 66, 72, 1.000)" ], [ 0.5529411764705883, "rgba(206, 67, 71, 1.000)" ], [ 0.5568627450980392, "rgba(207, 68, 70, 1.000)" ], [ 0.5607843137254902, "rgba(208, 69, 69, 1.000)" ], [ 0.5647058823529412, "rgba(210, 70, 68, 1.000)" ], [ 0.5686274509803921, "rgba(211, 71, 67, 1.000)" ], [ 0.5725490196078431, "rgba(212, 72, 66, 1.000)" ], [ 0.5764705882352941, "rgba(213, 74, 65, 1.000)" ], [ 0.5803921568627451, "rgba(215, 75, 63, 1.000)" ], [ 0.5843137254901961, "rgba(216, 76, 62, 1.000)" ], [ 0.5882352941176471, "rgba(217, 77, 61, 1.000)" ], [ 0.592156862745098, "rgba(218, 78, 60, 1.000)" ], [ 0.596078431372549, "rgba(219, 80, 59, 1.000)" ], [ 0.6, "rgba(221, 81, 58, 1.000)" ], [ 0.6039215686274509, "rgba(222, 82, 56, 1.000)" ], [ 0.6078431372549019, "rgba(223, 83, 55, 1.000)" ], [ 0.611764705882353, "rgba(224, 85, 54, 1.000)" ], [ 0.615686274509804, "rgba(225, 86, 53, 1.000)" ], [ 0.6196078431372549, "rgba(226, 87, 52, 1.000)" ], [ 0.6235294117647059, "rgba(227, 89, 51, 1.000)" ], [ 0.6274509803921569, "rgba(228, 90, 49, 1.000)" ], [ 0.6313725490196078, "rgba(229, 92, 48, 1.000)" ], [ 0.6352941176470588, "rgba(230, 93, 47, 1.000)" ], [ 0.6392156862745098, "rgba(231, 94, 46, 1.000)" ], [ 0.6431372549019608, "rgba(232, 96, 45, 1.000)" ], [ 0.6470588235294118, "rgba(233, 97, 43, 1.000)" ], [ 0.6509803921568628, "rgba(234, 99, 42, 1.000)" ], [ 0.6549019607843137, "rgba(235, 100, 41, 1.000)" ], [ 0.6588235294117647, "rgba(235, 102, 40, 1.000)" ], [ 0.6627450980392157, "rgba(236, 103, 38, 1.000)" ], [ 0.6666666666666666, "rgba(237, 105, 37, 1.000)" ], [ 0.6705882352941176, "rgba(238, 106, 36, 1.000)" ], [ 0.6745098039215687, "rgba(239, 108, 35, 1.000)" ], [ 0.6784313725490196, "rgba(239, 110, 33, 1.000)" ], [ 0.6823529411764706, "rgba(240, 111, 32, 1.000)" ], [ 0.6862745098039216, "rgba(241, 113, 31, 1.000)" ], [ 0.6901960784313725, "rgba(241, 115, 29, 1.000)" ], [ 0.6941176470588235, "rgba(242, 116, 28, 1.000)" ], [ 0.6980392156862745, "rgba(243, 118, 27, 1.000)" ], [ 0.7019607843137254, "rgba(243, 120, 25, 1.000)" ], [ 0.7058823529411765, "rgba(244, 121, 24, 1.000)" ], [ 0.7098039215686275, "rgba(245, 123, 23, 1.000)" ], [ 0.7137254901960784, "rgba(245, 125, 21, 1.000)" ], [ 0.7176470588235294, "rgba(246, 126, 20, 1.000)" ], [ 0.7215686274509804, "rgba(246, 128, 19, 1.000)" ], [ 0.7254901960784313, "rgba(247, 130, 18, 1.000)" ], [ 0.7294117647058823, "rgba(247, 132, 16, 1.000)" ], [ 0.7333333333333333, "rgba(248, 133, 15, 1.000)" ], [ 0.7372549019607844, "rgba(248, 135, 14, 1.000)" ], [ 0.7411764705882353, "rgba(248, 137, 12, 1.000)" ], [ 0.7450980392156863, "rgba(249, 139, 11, 1.000)" ], [ 0.7490196078431373, "rgba(249, 140, 10, 1.000)" ], [ 0.7529411764705882, "rgba(249, 142, 9, 1.000)" ], [ 0.7568627450980392, "rgba(250, 144, 8, 1.000)" ], [ 0.7607843137254902, "rgba(250, 146, 7, 1.000)" ], [ 0.7647058823529411, "rgba(250, 148, 7, 1.000)" ], [ 0.7686274509803922, "rgba(251, 150, 6, 1.000)" ], [ 0.7725490196078432, "rgba(251, 151, 6, 1.000)" ], [ 0.7764705882352941, "rgba(251, 153, 6, 1.000)" ], [ 0.7803921568627451, "rgba(251, 155, 6, 1.000)" ], [ 0.7843137254901961, "rgba(251, 157, 7, 1.000)" ], [ 0.788235294117647, "rgba(252, 159, 7, 1.000)" ], [ 0.792156862745098, "rgba(252, 161, 8, 1.000)" ], [ 0.796078431372549, "rgba(252, 163, 9, 1.000)" ], [ 0.8, "rgba(252, 165, 10, 1.000)" ], [ 0.803921568627451, "rgba(252, 166, 12, 1.000)" ], [ 0.807843137254902, "rgba(252, 168, 13, 1.000)" ], [ 0.8117647058823529, "rgba(252, 170, 15, 1.000)" ], [ 0.8156862745098039, "rgba(252, 172, 17, 1.000)" ], [ 0.8196078431372549, "rgba(252, 174, 18, 1.000)" ], [ 0.8235294117647058, "rgba(252, 176, 20, 1.000)" ], [ 0.8274509803921568, "rgba(252, 178, 22, 1.000)" ], [ 0.8313725490196079, "rgba(252, 180, 24, 1.000)" ], [ 0.8352941176470589, "rgba(251, 182, 26, 1.000)" ], [ 0.8392156862745098, "rgba(251, 184, 29, 1.000)" ], [ 0.8431372549019608, "rgba(251, 186, 31, 1.000)" ], [ 0.8470588235294118, "rgba(251, 188, 33, 1.000)" ], [ 0.8509803921568627, "rgba(251, 190, 35, 1.000)" ], [ 0.8549019607843137, "rgba(250, 192, 38, 1.000)" ], [ 0.8588235294117647, "rgba(250, 194, 40, 1.000)" ], [ 0.8627450980392157, "rgba(250, 196, 42, 1.000)" ], [ 0.8666666666666667, "rgba(250, 198, 45, 1.000)" ], [ 0.8705882352941177, "rgba(249, 199, 47, 1.000)" ], [ 0.8745098039215686, "rgba(249, 201, 50, 1.000)" ], [ 0.8784313725490196, "rgba(249, 203, 53, 1.000)" ], [ 0.8823529411764706, "rgba(248, 205, 55, 1.000)" ], [ 0.8862745098039215, "rgba(248, 207, 58, 1.000)" ], [ 0.8901960784313725, "rgba(247, 209, 61, 1.000)" ], [ 0.8941176470588236, "rgba(247, 211, 64, 1.000)" ], [ 0.8980392156862745, "rgba(246, 213, 67, 1.000)" ], [ 0.9019607843137255, "rgba(246, 215, 70, 1.000)" ], [ 0.9058823529411765, "rgba(245, 217, 73, 1.000)" ], [ 0.9098039215686274, "rgba(245, 219, 76, 1.000)" ], [ 0.9137254901960784, "rgba(244, 221, 79, 1.000)" ], [ 0.9176470588235294, "rgba(244, 223, 83, 1.000)" ], [ 0.9215686274509803, "rgba(244, 225, 86, 1.000)" ], [ 0.9254901960784314, "rgba(243, 227, 90, 1.000)" ], [ 0.9294117647058824, "rgba(243, 229, 93, 1.000)" ], [ 0.9333333333333333, "rgba(242, 230, 97, 1.000)" ], [ 0.9372549019607843, "rgba(242, 232, 101, 1.000)" ], [ 0.9411764705882353, "rgba(242, 234, 105, 1.000)" ], [ 0.9450980392156862, "rgba(241, 236, 109, 1.000)" ], [ 0.9490196078431372, "rgba(241, 237, 113, 1.000)" ], [ 0.9529411764705882, "rgba(241, 239, 117, 1.000)" ], [ 0.9568627450980393, "rgba(241, 241, 121, 1.000)" ], [ 0.9607843137254902, "rgba(242, 242, 125, 1.000)" ], [ 0.9647058823529412, "rgba(242, 244, 130, 1.000)" ], [ 0.9686274509803922, "rgba(243, 245, 134, 1.000)" ], [ 0.9725490196078431, "rgba(243, 246, 138, 1.000)" ], [ 0.9764705882352941, "rgba(244, 248, 142, 1.000)" ], [ 0.9803921568627451, "rgba(245, 249, 146, 1.000)" ], [ 0.984313725490196, "rgba(246, 250, 150, 1.000)" ], [ 0.9882352941176471, "rgba(248, 251, 154, 1.000)" ], [ 0.9921568627450981, "rgba(249, 252, 157, 1.000)" ], [ 0.996078431372549, "rgba(250, 253, 161, 1.000)" ], [ 1, "rgba(252, 255, 164, 1.000)" ] ], "hoverinfo": "none", "name": "y1", "showlegend": false, "showscale": false, "type": "heatmap", "x": [ 0.0128, 0.038400000000000004, 0.064, 0.0896, 0.1152, 0.14079999999999998, 0.1664, 0.192, 0.21760000000000002, 0.2432, 0.26880000000000004, 0.2944, 0.31999999999999995, 0.3456, 0.3712, 0.39680000000000004, 0.4224, 0.44799999999999995, 0.4736, 0.4992, 0.5247999999999999, 0.5504, 0.5760000000000001, 0.6015999999999999 ], "xaxis": "x1", "y": [ 206.28042475607913, 218.0199501434289, 230.09329169669823, 242.16620447059756, 254.23873537228943, 266.3109424108493, 278.3828758470541, 290.4545629569614, 302.5260332280246, 314.59731162133244, 326.6684044285658, 338.73934430475504, 350.8101630848708, 362.8808588611056, 374.95144351293663, 387.0219274377323, 399.0923197749129, 411.162628590618, 423.2328459879931, 435.3029929281687, 447.3730909916008, 459.44312977239997, 471.5131138232096, 483.58304724212707, 495.6529337280521, 507.722761549631, 519.7925484590149, 531.8623130206663, 543.9320423089548, 556.1356501740689 ], "yaxis": "y1", "z": [ [ -11.17729663848877, -14.040947914123535, -10.702736854553223, -11.622337341308594, -13.23756217956543, -9.379115104675293, -12.041781425476074, -9.69075870513916, -17.56655963897705, -13.256103515625, -10.189560890197754, -12.75240707397461, -8.970640182495117, -13.204181671142578, -10.7095308303833, -11.263859748840332, -11.538761138916016, -9.712557792663574, -12.731974601745605, -10.130593299865723, -10.78668212890625, -10.871105194091797, -11.765107154846191 ], [ -8.978626251220703, -9.133123397827148, -7.6872076988220215, -10.72281551361084, -10.882070541381836, -9.797386169433594, -11.168856620788574, -9.480361938476562, -11.788610458374023, -10.897809028625488, -9.505719184875488, -9.667709350585938, -7.435202121734619, -11.756669998168945, -10.251459121704102, -12.099783897399902, -8.772926330566406, -8.992329597473145, -10.78456974029541, -9.592470169067383, -10.60915756225586, -9.061663627624512, -10.944787979125977 ], [ -9.153844833374023, -8.13261604309082, -8.400622367858887, -12.811984062194824, -12.293733596801758, -8.80688762664795, -8.286198616027832, -9.25818157196045, -11.956441879272461, -10.418660163879395, -9.022842407226562, -8.146432876586914, -9.116327285766602, -12.858036041259766, -9.90513801574707, -8.944662094116211, -8.002411842346191, -10.947328567504883, -12.368132591247559, -10.293060302734375, -8.9591064453125, -8.79842472076416, -12.671614646911621 ], [ -7.976927280426025, -6.915742874145508, -7.266646862030029, -12.051753997802734, -11.272368431091309, -7.590190410614014, -7.054614067077637, -8.062114715576172, -10.779090881347656, -9.213822364807129, -7.817893981933594, -6.922488212585449, -8.171142578125, -11.775318145751953, -8.704543113708496, -7.712452411651611, -6.790069580078125, -10.113722801208496, -11.39227294921875, -9.15774154663086, -7.733916282653809, -7.600794792175293, -11.74222469329834 ], [ -8.267821311950684, -7.043813705444336, -8.200440406799316, -11.674964904785156, -10.813314437866211, -7.347163677215576, -6.950209617614746, -10.463663101196289, -13.10602855682373, -9.400032997131348, -6.893754005432129, -7.341622829437256, -10.094367027282715, -12.704815864562988, -8.08458423614502, -6.827395915985107, -7.188565254211426, -14.624306678771973, -12.190865516662598, -7.893646717071533, -6.869201183319092, -7.593017101287842, -12.659906387329102 ], [ -8.249963760375977, -7.025956153869629, -8.18258285522461, -11.65710735321045, -10.795456886291504, -7.329306125640869, -6.932352066040039, -10.445804595947266, -13.088171005249023, -9.38217544555664, -6.875896453857422, -7.323765277862549, -10.076509475708008, -12.686958312988281, -8.066725730895996, -6.8095383644104, -7.170707702636719, -14.606449127197266, -12.17300796508789, -7.875789165496826, -6.851343631744385, -7.575159549713135, -12.642048835754395 ], [ -9.37169075012207, -9.065746307373047, -8.778221130371094, -14.472206115722656, -11.832266807556152, -8.06093978881836, -8.80253791809082, -9.117319107055664, -12.519980430603027, -9.623798370361328, -7.4600300788879395, -8.772964477539062, -10.051909446716309, -14.682262420654297, -8.125751495361328, -7.638628959655762, -8.92046070098877, -11.768354415893555, -10.732588768005371, -7.509759426116943, -7.4946417808532715, -7.5639495849609375, -16.130298614501953 ], [ -10.517594337463379, -10.243886947631836, -9.918052673339844, -15.58411979675293, -12.972407341003418, -9.217430114746094, -9.978483200073242, -10.180649757385254, -13.684693336486816, -10.806244850158691, -8.62775993347168, -9.942499160766602, -11.136642456054688, -15.796354293823242, -9.293529510498047, -8.818155288696289, -10.081900596618652, -12.888895988464355, -11.881453514099121, -8.664103507995605, -8.678078651428223, -8.72152042388916, -16.96041488647461 ], [ -10.514508247375488, -12.131831169128418, -9.769253730773926, -14.957194328308105, -12.830496788024902, -9.537088394165039, -11.537810325622559, -9.061120986938477, -14.359038352966309, -14.143710136413574, -9.473045349121094, -10.906281471252441, -10.2022705078125, -15.19914722442627, -10.141807556152344, -10.988439559936523, -10.599345207214355, -12.385628700256348, -11.95836353302002, -8.909078598022461, -13.408857345581055, -9.08107852935791, -14.875675201416016 ], [ -12.754461288452148, -11.555351257324219, -10.82151985168457, -15.15649700164795, -14.605015754699707, -10.958298683166504, -12.769811630249023, -12.416929244995117, -14.570006370544434, -12.748672485351562, -11.156662940979004, -10.006295204162598, -12.745153427124023, -16.251001358032227, -11.660234451293945, -12.11404037475586, -10.171317100524902, -13.272747993469238, -12.399386405944824, -11.510723114013672, -14.835794448852539, -11.123065948486328, -15.911356925964355 ], [ -11.934649467468262, -10.735539436340332, -10.001708030700684, -14.336685180664062, -13.78520393371582, -10.138486862182617, -11.949999809265137, -11.59711742401123, -13.750194549560547, -11.928860664367676, -10.336851119995117, -9.186483383178711, -11.925341606140137, -15.431188583374023, -10.840422630310059, -11.294227600097656, -9.351505279541016, -12.452935218811035, -11.579574584960938, -10.690911293029785, -14.015982627868652, -10.303254127502441, -15.091545104980469 ], [ -12.192322731018066, -9.520005226135254, -11.00177001953125, -13.464664459228516, -13.362631797790527, -10.444851875305176, -9.520263671875, -11.19640827178955, -16.368694305419922, -13.289701461791992, -9.042948722839355, -8.951616287231445, -12.891531944274902, -13.355557441711426, -11.352693557739258, -8.995170593261719, -8.764395713806152, -14.600625991821289, -13.240436553955078, -9.95344066619873, -9.360068321228027, -9.791667938232422, -13.241547584533691 ], [ -12.498252868652344, -9.825936317443848, -11.307701110839844, -13.770594596862793, -13.668561935424805, -10.750782012939453, -9.826193809509277, -11.502339363098145, -16.674625396728516, -13.595632553100586, -9.348878860473633, -9.257547378540039, -13.19746208190918, -13.661487579345703, -11.658623695373535, -9.301100730895996, -9.070326805114746, -14.906557083129883, -13.546367645263672, -10.259371757507324, -9.665998458862305, -10.097599029541016, -13.547477722167969 ], [ -13.491454124450684, -9.99346923828125, -12.192988395690918, -13.21334457397461, -13.959832191467285, -10.85214900970459, -9.265921592712402, -11.233301162719727, -12.847569465637207, -11.966476440429688, -8.753928184509277, -9.419456481933594, -14.27206039428711, -15.47323989868164, -10.679780960083008, -7.929504871368408, -9.454301834106445, -13.282334327697754, -12.197381019592285, -9.604155540466309, -8.215398788452148, -9.607800483703613, -12.949203491210938 ], [ -14.527894020080566, -11.60716724395752, -12.736573219299316, -14.021136283874512, -15.553152084350586, -12.289794921875, -10.862264633178711, -11.938426971435547, -12.924074172973633, -12.802967071533203, -10.336750030517578, -10.886163711547852, -13.934714317321777, -16.044918060302734, -11.983379364013672, -9.52464771270752, -11.118587493896484, -13.601727485656738, -13.034737586975098, -10.857743263244629, -9.839628219604492, -11.056365013122559, -14.378129959106445 ], [ -13.217745780944824, -12.032540321350098, -11.082612037658691, -12.515811920166016, -15.783870697021484, -11.714675903320312, -11.119348526000977, -10.367931365966797, -11.11273193359375, -11.31794261932373, -10.481547355651855, -10.412920951843262, -12.043731689453125, -14.404058456420898, -11.06320571899414, -9.771174430847168, -12.348604202270508, -11.860001564025879, -11.550341606140137, -9.8429536819458, -10.384655952453613, -10.517974853515625, -13.774892807006836 ], [ -11.849270820617676, -14.375460624694824, -10.928409576416016, -13.974508285522461, -15.768285751342773, -13.22099781036377, -14.424263000488281, -13.30091667175293, -12.558770179748535, -11.969202041625977, -13.08275032043457, -12.364618301391602, -12.51909351348877, -16.658599853515625, -12.284937858581543, -14.793522834777832, -11.478887557983398, -16.125411987304688, -13.514237403869629, -11.500015258789062, -12.764820098876953, -12.424152374267578, -14.972095489501953 ], [ -11.3858003616333, -13.91199016571045, -10.46493911743164, -13.511037826538086, -15.304815292358398, -12.757527351379395, -13.960793495178223, -12.837446212768555, -12.09529972076416, -11.505731582641602, -12.619279861450195, -11.901147842407227, -12.055623054504395, -16.19512939453125, -11.821467399597168, -14.330052375793457, -11.015417098999023, -15.661941528320312, -13.050766944885254, -11.036544799804688, -12.301349639892578, -11.96068286895752, -14.508625030517578 ], [ -10.932562828063965, -10.515260696411133, -10.002362251281738, -14.437016487121582, -13.123441696166992, -10.790146827697754, -10.062576293945312, -12.401450157165527, -13.313572883605957, -11.541167259216309, -12.10093879699707, -11.26829719543457, -11.237385749816895, -14.327326774597168, -11.561692237854004, -14.250675201416016, -11.10297966003418, -13.612001419067383, -14.37867546081543, -10.69786548614502, -12.269683837890625, -11.281207084655762, -16.823028564453125 ], [ -11.579194068908691, -11.161892890930176, -10.648994445800781, -15.083648681640625, -13.770073890686035, -11.436779022216797, -10.709208488464355, -13.048081398010254, -13.960205078125, -12.187798500061035, -12.747570991516113, -11.914929389953613, -11.884017944335938, -14.973958969116211, -12.208324432373047, -14.897307395935059, -11.749611854553223, -14.258633613586426, -15.025306701660156, -11.344497680664062, -12.916315078735352, -11.927839279174805, -17.46965980529785 ], [ -10.992962837219238, -9.587711334228516, -10.247649192810059, -14.45694637298584, -12.476621627807617, -9.671512603759766, -9.113068580627441, -12.182343482971191, -14.646881103515625, -12.396955490112305, -9.645736694335938, -13.92237377166748, -12.700997352600098, -13.070747375488281, -10.65249252319336, -10.496468544006348, -11.208769798278809, -14.101664543151855, -13.116353034973145, -10.113555908203125, -10.721994400024414, -11.300751686096191, -14.287877082824707 ], [ -13.00723648071289, -11.8595552444458, -12.105077743530273, -14.374492645263672, -14.451744079589844, -11.762995719909668, -11.14881420135498, -14.538661003112793, -17.159055709838867, -13.81130599975586, -11.222517967224121, -12.633257865905762, -13.238507270812988, -14.57216739654541, -11.47905445098877, -11.79453182220459, -13.325469970703125, -14.480111122131348, -14.537543296813965, -11.150675773620605, -11.946113586425781, -12.58794116973877, -15.657703399658203 ], [ -12.504852294921875, -11.925326347351074, -11.408638000488281, -13.041775703430176, -13.894261360168457, -11.3866548538208, -10.678977012634277, -14.956770896911621, -17.56655963897705, -12.798741340637207, -10.299596786499023, -11.246648788452148, -11.976061820983887, -13.604837417602539, -10.27086353302002, -10.729970932006836, -12.996397018432617, -13.194759368896484, -13.5283203125, -9.995941162109375, -10.852688789367676, -11.518946647644043, -14.624188423156738 ], [ -14.535675048828125, -15.74465274810791, -11.4791259765625, -13.891066551208496, -14.219240188598633, -15.544363021850586, -14.38767147064209, -13.94815731048584, -16.461673736572266, -13.823659896850586, -14.845547676086426, -11.36837387084961, -11.51125431060791, -15.202491760253906, -11.102834701538086, -13.971756935119629, -11.998734474182129, -13.29617691040039, -15.084444999694824, -11.20279312133789, -12.761333465576172, -12.4512357711792, -15.301923751831055 ], [ -14.401546478271484, -15.61052417755127, -11.34499740600586, -13.756937980651855, -14.085112571716309, -15.410234451293945, -14.25354290008545, -13.8140287399292, -16.327545166015625, -13.689531326293945, -14.711419105529785, -11.234245300292969, -11.37712574005127, -15.068363189697266, -10.968706130981445, -13.837628364562988, -11.864605903625488, -13.16204833984375, -14.950316429138184, -11.06866455078125, -12.627204895019531, -12.317107200622559, -15.167795181274414 ], [ -13.393621444702148, -11.741941452026367, -10.09536361694336, -13.547048568725586, -14.818913459777832, -14.209256172180176, -11.447731018066406, -12.042362213134766, -13.676552772521973, -14.121664047241211, -11.925936698913574, -10.538409233093262, -11.232132911682129, -16.77503204345703, -11.874042510986328, -13.966181755065918, -10.494840621948242, -13.197190284729004, -13.828080177307129, -11.531784057617188, -12.77908706665039, -11.699114799499512, -14.64062213897705 ], [ -14.364507675170898, -12.620513916015625, -11.095632553100586, -14.572169303894043, -15.80435848236084, -14.800766944885254, -12.332437515258789, -13.065499305725098, -14.654053688049316, -15.11203384399414, -12.865124702453613, -11.538352966308594, -12.251829147338867, -17.56655963897705, -12.898941040039062, -14.262887954711914, -11.457711219787598, -14.203701972961426, -14.74447250366211, -12.543126106262207, -13.715096473693848, -12.643657684326172, -15.646699905395508 ], [ -12.24966812133789, -9.593761444091797, -9.68102741241455, -15.289678573608398, -13.97406005859375, -10.840424537658691, -9.344491004943848, -13.312906265258789, -12.658060073852539, -13.400999069213867, -10.327057838439941, -10.112424850463867, -11.99926471710205, -14.37363338470459, -13.551417350769043, -9.920012474060059, -9.216397285461426, -13.036721229553223, -11.99009895324707, -11.622838973999023, -11.143585205078125, -10.164830207824707, -14.460363388061523 ], [ -15.251954078674316, -11.351555824279785, -12.702089309692383, -14.253878593444824, -15.805771827697754, -11.544299125671387, -10.8381929397583, -12.651472091674805, -14.534598350524902, -14.541912078857422, -11.00705337524414, -11.45253849029541, -11.988042831420898, -17.56655963897705, -15.531322479248047, -10.479989051818848, -11.243630409240723, -14.298867225646973, -13.110448837280273, -16.192476272583008, -10.642587661743164, -10.578691482543945, -14.58176326751709 ] ], "zmax": -6.790069580078125, "zmin": -17.56655963897705 } ], "layout": { "annotations": [ { "font": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 20 }, "rotation": 0, "showarrow": false, "text": "Mel Spectrogram", "x": 0.5571759259259259, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "top", "yref": "paper" } ], "height": 400, "legend": { "bgcolor": "rgba(255, 255, 255, 1.000)", "bordercolor": "rgba(0, 0, 0, 1.000)", "font": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 11 }, "tracegroupgap": 0, "x": 1, "y": 1 }, "margin": { "b": 20, "l": 0, "r": 0, "t": 20 }, "paper_bgcolor": "rgba(255, 255, 255, 1.000)", "plot_bgcolor": "rgba(255, 255, 255, 1.000)", "showlegend": true, "width": 600, "xaxis": { "anchor": "y1", "domain": [ 0.1209135316418781, 0.9934383202099738 ], "gridcolor": "rgba(0, 0, 0, 0.100)", "gridwidth": 0.5, "linecolor": "rgba(0, 0, 0, 1.000)", "mirror": false, "range": [ 0.0128, 0.6015999999999999 ], "showgrid": true, "showline": true, "showticklabels": true, "tickangle": 0, "tickcolor": "rgb(0, 0, 0)", "tickfont": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 11 }, "tickmode": "array", "ticks": "inside", "ticktext": [ "0:0", "0:0", "0:0", "0:0", "0:0", "0:1" ], "tickvals": [ 0.1, 0.2, 0.30000000000000004, 0.4, 0.5, 0.6000000000000001 ], "title": "Time [s]", "titlefont": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 15 }, "type": "-", "visible": true, "zeroline": false, "zerolinecolor": "rgba(0, 0, 0, 1.000)" }, "yaxis": { "anchor": "x1", "domain": [ 0.07581474190726165, 0.9415463692038496 ], "gridcolor": "rgba(0, 0, 0, 0.100)", "gridwidth": 0.5, "linecolor": "rgba(0, 0, 0, 1.000)", "mirror": false, "range": [ 2.314458016999906, 2.745180735712794 ], "showgrid": true, "showline": true, "showticklabels": true, "tickangle": 0, "tickcolor": "rgb(0, 0, 0)", "tickfont": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 11 }, "tickmode": "array", "ticks": "inside", "ticktext": [ "10^2.4", "10^2.5", "10^2.6", "10^2.7" ], "tickvals": [ 251.18864315095823, 316.22776601683796, 398.1071705534973, 501.18723362727246 ], "title": "Frequency [Hz]", "titlefont": { "color": "rgba(0, 0, 0, 1.000)", "family": "sans-serif", "size": 15 }, "type": "log", "visible": true, "zeroline": false, "zerolinecolor": "rgba(0, 0, 0, 1.000)" } } }, "text/html": [ "\n", "\n", "
\n", "