Logo

A.I. researchers slap dance dance community in the face.

Register Log In Back To Forums

Post #1 · Posted at 2020-04-28 09:47:21pm 5.1 years ago

Offline Dimentian
Dimentian Avatar Member
16 Posts
Not Set
Reg. 2020-04-04

Develop AI that can turn any song on YouTube into a playable Beat Saber map, blowing off the much older and established dance dance community.

https://uploadvr.com/beat-sage-ai-beat-saber-custom/

Similar to Dance Dance Convolution, but actually works. Roll Eyes

Blushing

Mad

Quote
The one catch is that only certain types of music work well. As expected, most slow ballads or rock music will produce strange (or just boring) results. However, if you give Beat Sage a pop track with a very strong beat and electronic tone, the results are incredible.

Quote
Quote
Beat Sage uses two neural networks to map an audio file into a plausible Beat Saber level. These neural networks were trained on Beat Saber levels created by humans. The first neural network listens to the audio and predicts at what points in time blocks should be placed. The second neural network looks at the predicted timings and maps each to a timestamp to a block type (e.g. red up, blue down, red up + blue down).

Quote
These neural networks are the reason Beat Sage maps work so well, while also managing to capture the essence and subtleties of Beat Games’ mappings.

It’s all the work of Chris Donahue and Abhay Agarwal, who are actively developing Beat Sage alongside their day jobs. While chatting with them earlier today, they wanted to stress that the tool is still actively in development, and improvements will continue to be made. While Beat Sage is incredibly impressive already, hopefully it will only get better from here.

In particular, upcoming changes to the AI will address problematic mappings that limit visibility or hinder your flow, which can be a problem with the current tracks. Beat Sage only supports standard notes, bombs and Normal through to Expert+ difficulties at the moment, but they’re planning to add more features (like walls and 90/360 degree modes) as they build support through their Patreon.

While the tool isn’t perfect and doesn’t work with all styles of music, it is still the absolute best AI track generator I’ve seen for any rhythm game. It produces levels which are not only a ball to play, but also challenging and similar in style to the official Beat Saber maps. You can try out Beat Sage for yourself now, with even more improvements to the AI to come in the future.

Post #2 · Posted at 2020-04-28 10:13:28pm 5.1 years ago

Offline Silver Spirit
Silver Spirit Avatar Member
6,742 Posts
United States
Reg. 2008-09-14

Nintendo Switch Friend Code: SW-2249-7707-55923DS Friend Code: 2578-3309-2697
"i was born at a very young age"

Last updated: 2020-04-29 03:21am
beat sage and ddc were made by the same researcher so idk what point you're trying to make here

Post #3 · Posted at 2020-04-28 10:18:24pm 5.1 years ago

Offline BemaniHyper
BemaniHyper Avatar Member+
1,435 Posts
United States
Reg. 2013-09-13

lol

Post #4 · Posted at 2020-04-28 10:37:25pm 5.1 years ago

Offline Bostengaable
Bostengaable Avatar Member
53 Posts
Brazil
Reg. 2019-04-08

Beat saber community is insane, hahaha.
This A.I. is good but...is perfect as normal custom charts made by hand? only time will tell.

I will try the Dance Dance Convolution, I'm so curious to see how it works.
Siga me os Bons..

Post #5 · Posted at 2020-04-28 10:46:12pm 5.1 years ago

Post #6 · Posted at 2020-04-29 07:53:03am 5.1 years ago

Offline Oni-91
Oni-91 Avatar Moderator+
13,518 Posts
United Kingdom
Reg. 2006-10-20

Nintendo Switch Friend Code: SW-3445-5569-17913DS Friend Code: 008736577880
"Popular bisexual disaster"
Wow, they actually worked out how to sync autogens (almost) properly. Only took them 20+ years.
ZIv Mod Squad: "I'm a trash panda now, don't worry about it"
Can you make music? ZENIUS -I- MANIA 2023 NEEDS YOU
https://pbs.twimg.com/media/FvT2ARPaQAAxRVX.jpg:large

Post #7 · Posted at 2020-04-29 08:50:02pm 5.1 years ago

Offline Dimentian
Dimentian Avatar Member
16 Posts
Not Set
Reg. 2020-04-04

Quote: Bostengaable

I will try the Dance Dance Convolution, I'm so curious to see how it works.
It doesn't

Post #8 · Posted at 2020-04-29 11:33:11pm 5.1 years ago

Offline Bostengaable
Bostengaable Avatar Member
53 Posts
Brazil
Reg. 2019-04-08


Last updated: 2020-04-29 11:39pm
Quote: Dimentian
Quote: Bostengaable

I will try the Dance Dance Convolution, I'm so curious to see how it works.
It doesn't

Why? is not open source? CryCry

*Edit: I found a web page that create a automatic sm file, is this? i think that was a program, tool or a stepmania framework.
I will test with a song of mine, but with some "modifications".
Siga me os Bons..

Post #9 · Posted at 2020-04-30 02:52:24pm 5.1 years ago

Offline hooky
hooky Avatar Member
2,683 Posts
United States
Reg. 2007-07-28

Besides Power (which actually seems kinda fun), they all seem like they're just hard and not innately fun. Don't Start Now was pretty much ruined by the prechorus. Some of those notes don't even go to anything, and the flow is off.
Register Log In Back To Forums

0 User(s) Viewing This Thread (Past 15 Minutes)

©2006-2025 Zenius -I- vanisher.com -5th style- IIPrivacy Policy
Web Server: 4% · Database: 8% · Server Time: 2025-06-17 22:16:10
This page took 0.007 seconds to execute.
Theme: starlight · Language: englishuk
Reset Theme & Language