Post #1 · Posted at 2020-04-28 09:47:21pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
16 Posts | |
Not Set | |
Reg. 2020-04-04 | |
Develop AI that can turn any song on YouTube into a playable Beat Saber map, blowing off the much older and established dance dance community.
https://uploadvr.com/beat-sage-ai-beat-saber-custom/
Similar to Dance Dance Convolution, but actually works.


https://uploadvr.com/beat-sage-ai-beat-saber-custom/
Similar to Dance Dance Convolution, but actually works.



Quote
The one catch is that only certain types of music work well. As expected, most slow ballads or rock music will produce strange (or just boring) results. However, if you give Beat Sage a pop track with a very strong beat and electronic tone, the results are incredible.
Quote
Quote
Beat Sage uses two neural networks to map an audio file into a plausible Beat Saber level. These neural networks were trained on Beat Saber levels created by humans. The first neural network listens to the audio and predicts at what points in time blocks should be placed. The second neural network looks at the predicted timings and maps each to a timestamp to a block type (e.g. red up, blue down, red up + blue down).
Quote
These neural networks are the reason Beat Sage maps work so well, while also managing to capture the essence and subtleties of Beat Games’ mappings.
It’s all the work of Chris Donahue and Abhay Agarwal, who are actively developing Beat Sage alongside their day jobs. While chatting with them earlier today, they wanted to stress that the tool is still actively in development, and improvements will continue to be made. While Beat Sage is incredibly impressive already, hopefully it will only get better from here.
In particular, upcoming changes to the AI will address problematic mappings that limit visibility or hinder your flow, which can be a problem with the current tracks. Beat Sage only supports standard notes, bombs and Normal through to Expert+ difficulties at the moment, but they’re planning to add more features (like walls and 90/360 degree modes) as they build support through their Patreon.
While the tool isn’t perfect and doesn’t work with all styles of music, it is still the absolute best AI track generator I’ve seen for any rhythm game. It produces levels which are not only a ball to play, but also challenging and similar in style to the official Beat Saber maps. You can try out Beat Sage for yourself now, with even more improvements to the AI to come in the future.
It’s all the work of Chris Donahue and Abhay Agarwal, who are actively developing Beat Sage alongside their day jobs. While chatting with them earlier today, they wanted to stress that the tool is still actively in development, and improvements will continue to be made. While Beat Sage is incredibly impressive already, hopefully it will only get better from here.
In particular, upcoming changes to the AI will address problematic mappings that limit visibility or hinder your flow, which can be a problem with the current tracks. Beat Sage only supports standard notes, bombs and Normal through to Expert+ difficulties at the moment, but they’re planning to add more features (like walls and 90/360 degree modes) as they build support through their Patreon.
While the tool isn’t perfect and doesn’t work with all styles of music, it is still the absolute best AI track generator I’ve seen for any rhythm game. It produces levels which are not only a ball to play, but also challenging and similar in style to the official Beat Saber maps. You can try out Beat Sage for yourself now, with even more improvements to the AI to come in the future.
Post #2 · Posted at 2020-04-28 10:13:28pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
6,742 Posts | |
![]() | |
Reg. 2008-09-14 | |
![]() ![]() | |
"i was born at a very young age" |
Last updated: 2020-04-29 03:21am
beat sage and ddc were made by the same researcher so idk what point you're trying to make here
Post #3 · Posted at 2020-04-28 10:18:24pm 5.1 years ago
![]() | |
---|---|
![]() |
Member+ |
1,435 Posts | |
![]() | |
Reg. 2013-09-13 | |
lol
Post #4 · Posted at 2020-04-28 10:37:25pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
53 Posts | |
![]() | |
Reg. 2019-04-08 | |
Beat saber community is insane, hahaha.
This A.I. is good but...is perfect as normal custom charts made by hand? only time will tell.
I will try the Dance Dance Convolution, I'm so curious to see how it works.
This A.I. is good but...is perfect as normal custom charts made by hand? only time will tell.
I will try the Dance Dance Convolution, I'm so curious to see how it works.
Post #5 · Posted at 2020-04-28 10:46:12pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
2,891 Posts | |
![]() | |
Reg. 2015-02-21 | |
![]() | |
"bootylicious " |
what
Post #6 · Posted at 2020-04-29 07:53:03am 5.1 years ago
![]() | |
---|---|
![]() |
Moderator+ |
13,518 Posts | |
![]() | |
Reg. 2006-10-20 | |
![]() ![]() | |
"Popular bisexual disaster" |
Wow, they actually worked out how to sync autogens (almost) properly. Only took them 20+ years.
Post #7 · Posted at 2020-04-29 08:50:02pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
16 Posts | |
Not Set | |
Reg. 2020-04-04 | |
Quote: Bostengaable
I will try the Dance Dance Convolution, I'm so curious to see how it works.
Post #8 · Posted at 2020-04-29 11:33:11pm 5.1 years ago
Quote: Dimentian
Quote: Bostengaable
I will try the Dance Dance Convolution, I'm so curious to see how it works.
Why? is not open source?


*Edit: I found a web page that create a automatic sm file, is this? i think that was a program, tool or a stepmania framework.
I will test with a song of mine, but with some "modifications".
Post #9 · Posted at 2020-04-30 02:52:24pm 5.1 years ago
![]() | |
---|---|
![]() |
Member |
2,683 Posts | |
![]() | |
Reg. 2007-07-28 | |
Besides Power (which actually seems kinda fun), they all seem like they're just hard and not innately fun. Don't Start Now was pretty much ruined by the prechorus. Some of those notes don't even go to anything, and the flow is off.