Differentiable DSP (PyTorch)

Pytorch Source: ddsp-pytorch

Original Source: magenta ddsp

 

Magenta's Work

Link : Magenta Sample Page

image-20200218134213270

image-20200218134246721

 

Ours

Fundamental FrequencyAmplitudeRoom Impulse Response
image-20200218134614513image-20200218134650814image-20200218134717163

 

Sample Audio (Violin)

Original Audio
Resynthesis
Additive Harmonics
Filtered Noise
Reverb Removed

 

Timbre Transfer (Singing to Violin), Pitch control

Original Audio(Singing)Violin VersionPitch modified Violin
image-20200218135510106image-20200218135517754image-20200218135529721

 

Room Acoustic Reverb Transfer

Source Audio(Violin)Target Audio(Singing)Transfered Audio
imgimage-20200218135510106img