Myvideo

Guest

Login

AI vocals - AMV Bernkastel x Lambdadelta singing 'Watching You'

Uploaded By: Myvideo
4 views
0
0 votes
0

Experimental video. This is an AMV where I used AI voice models of characters from the series to create the vocals for the song. The singers are Lambdadelta and Bernkastel from Umineko. Basically ever since I've been making AMVs (over 15 years), I've always thought it would be very cool if the characters from the shows could be singing the songs. And now, it seems the technology is getting there. So here's an AMV featuring footage of Rika, Bernkastel, Satoko, and Lambdadelta set to music where Bernkastel and Lambdadelta are singing the vocals. It's weird, I don't know if anyone else will enjoy this, but I'm entertained for the ~evening it took me to put this together. Notes: I did not create these models, I've just been dabbling with using a few existing ones. There are actually several Umineko ones out there, but I went with Bern and Lambda because they're some of my favorites. The technology still has a long way to tried out a bunch of songs and styles, and it is hit or miss. Various factors come into play, like the quality of the model, vocal effects confusing the model, the 'distinctiveness' of the vocals you're replacing. Also models based on Japanese voices seem to struggle sometimes with english songs (not totally unexpected) just cause the pronunciation of stuff is a bit different. But it's fun to play with, and I am impressed with some of the results. I think the Bern is the stronger of the two, it really captures some of her voice tone well. Some of the Bern songs I might actually keep and enjoy listening to in the future. Lambda sounds kind of obnoxious, but I guess that suits the character lol. Maybe in the future I'll make some models of my own models for other characters, but I don't think my PC is good enough to train them right now. The 'base' for the vocals and music is the Chase Holfelder cover of the Police's 'Every Breath You Take'. A pair of RVC2 AI voice models were each run with the filtered vocals. I then cut the songs into a duet, and added some reverb, and put it with the instrumental from the cover. It's not perfect, you can certainly hear a bit of weirdness in notice I only did the first minute of the song; that's cause neither of these models did great with the louder vocals that come in later, and things were clipping all over the place and not sounding great. I have already edited Higurashi to the original Police song too, so check that out if you like. I do think that's a better video than this one, I was rushing a bit here. THIS VIDEO IS FAN MADE AND FOR ENTERTAINMENT PURPOSES ONLY. NOT FOR ANY PROFIT. PLEASE SUPPORT OFFICIAL RELEASES. Footage: Umineko no naku koro ni, Higurashi gou/sotsu Music: “Every breath you take“ cover by Chase Holfelder Vocals: Bernkastel RVC2 and Lambdadelta RVC2 Editing for music and clips: Lita302

Share with your friends

Link:

Embed:

Video Size:

Custom size:

x

Add to Playlist:

Favorites
My Playlist
Watch Later