Maestro - Midi Player Tool Kit - 3d-spatialization

Maestro - Midi Player Tool Kit

Salons textuels / 3d-spatialization

Some good news on the MPTK Spatializer side for your VR app. Thank to @FalconEagle who proposed to test Resonance Audio. It's an ambisonic spatializer that works cross platform (Google's Open source project) So far, Maestro MPTK has been tested with these spatializers: ✅ Microsoft HRTF Spatializer (supports UWP and PC running Windows 10). ✅ and Oculus Spatializer. Now Resonance Audio can be added to the list ✅✅✅✅ and it sound very good

(edited)

21:19

The second good news is the capabilities to render 3D sound based on midi tracks, not only channels. The advantage of tracks is that your are not limited to the 16 midi channels. Of course, the midi limitation of 16 instruments simultaneously remains .... but the instruments can change during playing! (edited)

21:24

https://www.youtube.com/watch?v=wNLFJ3cxFdQ

Thierry Bachmann

Maestro MPTK ResonanceAudio

21:26

Third good news, Resonance Audio is also available with the Free version of MPTK but with no 3D scene build with channel or track: each MidiPayer with all instruments have the same position. (edited)

21:26

https://www.youtube.com/watch?v=lcMTMhmuoGo

Thierry Bachmann

Maestro Spatialization with Resonance Audio

Totally Awesome Achievement Thierry. This make MPTK super flexible into the VR space.

21:35

I have the Pro version, is there a way to get a copy of this new addition before it's updated in unity.

Yes, i send you a link, of course it's a beta

Setting for Resonance Audio: 1) Download (here https://resonance-audio.github.io/resonance-audio/develop/unity/getting-started.html) and import the Unity package, 2) In the MPTK Prefab AudioSource (MidiFilePlayer, MidiStream, MidiSpatializer (Pro)....) set the output source to Resonance Audio. (edited)

04:00

Image attachment

Thierry pinned a message to this channel. 28/05/2021 04:15

3) Set Resonance Audio in Project Setting / Audio

05:25

Image attachment

05:27

4) If you are not using the MidiSpatializer prefab ... (edited)

05:27

Image attachment

05:28

... but with the MidiPlayer or other Maestro prefab, the spatialization is also possible (with the limitation of one 3D position for the source of the sound : the prefab position). Don't forget to set the spatialization setting in the prefab inspector. (edited)

05:32

You have to defined these parameters:

05:32

Image attachment

5) Now testing DearVR compatibility with Maestro. It's ok, with some precautions: DearVR have low performance when sound generated is based on OnAudioFilterRead (it's the case for MPTK). It's ok for 3 or 4 AudioSource in parallel, not more. Below a very quick tuto: (edited)

22:14

5-1) Add the "Dear VR Source" component to the prefab MidiSpatializer and check “Unity Distance Graph”. I also recommend to uncheck "Internal Reverb" for performance reason. (edited)

Image attachment

22:16

5-2) On the AudioSource of the MidiSpatializer prefab, set the output to DearVR. (edited)

Image attachment

22:17

5-3) Add a DearVR manager somewhere on your scene (edited)

Image attachment

22:18

5.4) Set DearVR Audio in Project Setting / Audio Warning : this is not a full test of this plugin, it's only for testing the compatibility with Maestro MPTK. There is a lot of interesting function available with DearVR, please have a look their site. https://www.dear-reality.com/products/dearvr-unity (edited)

Create ultra-realistic acoustic environments in Unity using the number one spatializer plugin with a true-to-life perception of direction, distance, reflections, and reverb | 45 acoustic room presets | multiple reverbs on one source | real-time room analyzer | Adaptable acoustic | Occlusion control | performance mode

hello, ThiBach. this is the man who send mails to you these days. I want to know how to create a appoggiatura note through the code.

Image attachment

09:04

@Thierry

Appoggiatura don't exist in the MIDI norm. But to create a delay, just add a delay to the note: --> (edited)

11:06

 // Next note will be played one quarter after the previous
absoluteTime += ticksPerQuarterNote;
mfw.MPTK_AddNote(track1, absoluteTime, channel0, 61, 50, ticksPerQuarterNote);

absoluteTime += ticksPerQuarterNote;
mfw.MPTK_AddNote(track1, absoluteTime, channel0, 62, 50, ticksPerQuarterNote);

absoluteTime += ticksPerQuarterNote;
mfw.MPTK_AddNote(track1, absoluteTime, channel0, 63, 50, ticksPerQuarterNote);

(edited)

11:06

you will hear three notes at a fixed position for playing, now add the last note of the bar with a small delay --> (with correction) (edited)

11:07

absoluteTime += ticksPerQuarterNote); mfw.MPTK_AddNote(track1, absoluteTime + (ticksPerQuarterNote /4), channel0, 63, 50, ticksPerQuarterNote); (edited)

11:07

The fourth note will be play with a of delay of quarter/4 (edited)

@Thierry Sorry about not online at weekend. Now I see, Thank you.

Please everyone, please vote for this fix which will enable Spatialization to work well. https://issuetracker.unity3d.com/issues/audio-sound-generated-by-onaudiofilterread-disappears-when-spatialize-is-enabled

Unity IssueTracker - [Audio] Sound generated by OnAudioFilterRead d...

How to reproduce: 1. Open attached project "case1246343.zip" and scene "SampleScene" 2. Enter Play mode 3. In Hierarchy window selec...

I just tested the latest version of Maestro Pro with Unity 2021.3 LTS and DearVR. Windows 10. Example "SpatializeFly" doesnt seem to work and a number of errors popping up. Have to tested this example recently? (edited)

Image attachment

There is something up with the latest macos / unity. Basically the channel buffer size is misreported. You can change this so the system uses default sizes in the editor, and that makes it work, but if you restart unity, it stops working again. Something that the system does when the defaults are changed makes the system start working again, but it doesn't work from a cold start. I've been looking into this myself recently.

Jake Simpson

There is something up with the latest macos / unity. Basically the channel buffer size is misreported. You can change this so the system uses default sizes in the editor, and that makes it work, but if you restart unity, it stops working again. Something that the system does when the defaults are changed makes the system start working again, but it doesn't work from a cold start. I've been looking into this myself recently.

Thanks Jake, I'm on Windows 10

Steam Audio has been tested with succes! This page is updated if you are interested: https://paxstellar.fr/setup-mptk-sound-spatialization/

Thierry Bachmann

Maestro MPTK - Sound Spatialization with Unity -

Sound spatialization in a nutshell! On this page, you’ll find detailed instructions on setting up spatialization in Unity, along with how Maestro MPTK can assist you. What Spatialize sound is? Audio Spatializers use “physical” characteristics of a scene, such as the Read more…

Last Steam Audio version 4.5.3 tested with success with Mac and Windows.

07:57

Just check this symbols is defined after setup:

Image attachment

07:58

And menu is available:

Image attachment

07:58

A must have! (edited)

Exported 40 message(s)

Timezone: UTC+1