Rendered at 06:16:20 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
sara_kumodeck 1 hours ago [-]
Having the model as just one more players in a live match with friends is a fun way to show off tis speed
joshstrange 12 hours ago [-]
I beat Jev and only failed on the dart board, I have zero idea how to read a dart board.
totisjosema 11 hours ago [-]
Well, good that you beat Jev anyway , not many do :)
nickabe 11 hours ago [-]
You might want to adjust the scoring.
A simple system would be something like:
- accuracy is most important
- if tied on accuracy (ie both got 8/10) then tie break is done on speed
In general, across a lot of games - winning is a big determinant in who comes back. Right now it might be very difficult to beat JEV with the way your scoring is setup.
For my game in particular it's like a 47% chance that a winning player returns versus just 10% for non-winners.
totisjosema 11 hours ago [-]
Each game mode tests different things.
Sprint is all about speed, it will be hard to beat JEV if he doesnt fail but one failure adds 15s. So you have a chance (in fact JEV gets around 80% right)
Versus Measures accuracy but under time pressure, if you score more than Jev you will win.
And streak is also accuracy.
This quiz game, is supposed to visualize how good and bad these type of models are. They can be very fast but they can also fail 20% of the times. As a human, can you beat that?
ajjenkins 11 hours ago [-]
This is fun, and a good demonstration of Jev’s capabilities.
It’s obviously much faster than a human, but it’s interesting that it only got 7/10 right on both rounds (same as me). I’m wondering what Jev could be trusted to do reliably given these results.
I guess it wasn’t optimized for these types of trivia questions. Or maybe the image capabilities are too new and need refinement.
totisjosema 11 hours ago [-]
Thanks for the feedback, and you got the purpose of this little app exactly right.
Each game mode tests different things. And it shows the strengths and weaknesses of this model. In streak almost all humans will win, but in sprint very few, however, very good humans will still beat the machine.
Jev and decision models, can make decisions very fast, in this quiz with around 80% accuracy, each use case will need to define if its good enough or not.
nextaccountic 14 hours ago [-]
Could you add an option to remove musical theory questions? I mean, I know Jev can ace those as well, but I can only click at random, that's unfun
ajjenkins 11 hours ago [-]
In my opinion the the point of the site is that Jev has knowledge on all topics that makes it hard to beat. It might not be as smart as you, but it probably has a greater breadth of knowledge.
nextaccountic 5 hours ago [-]
Yeah but this is also a fun, addictive game and I was invested into beating Jev, but every run where musical theory appeared had to be aborted
totisjosema 14 hours ago [-]
just play again :), but will consider adding whitelist/blacklist of categories
folmar 13 hours ago [-]
also less USification would help, it's not common knowledge how US birds or bridges or hats look like
totisjosema 11 hours ago [-]
will add more cards, thanks for the feedback
hluska 12 hours ago [-]
Considering this whole thing is AI slop, you could be a lot more polite when people make feature requests.
totisjosema 12 hours ago [-]
sorry you saw it that way, was just kidding, there are many categories unlucky of him that the one he doesnt like landed on his deck
Anyway the feature he requested was literally on the app 5 minutes after he asked :)
jrflo 14 hours ago [-]
Very cool demo! Although I feel that incorrect answers should be penalized more. For instance- I got 100% in about 45 seconds on the sprint. Then, I clicked through as fast as I can (only limited by finding the right targets) and got a score of 42s, technically better than my first score but I only got 20% right.
totisjosema 14 hours ago [-]
Thanks for the feedback! And now that you showed everyone a cheat sheet we will get many high scores, so lets increase the penalty of wrong answers and reset the leaderboard! Thanks a lot for the insights
podnami 12 hours ago [-]
This was pure fun for 62s until I found out how lousy I am
totisjosema 11 hours ago [-]
Jev has been humbling many today (including me)
Still fun to play tho, invite some games and play with them.
arjie 14 hours ago [-]
Would prefer if the audio button was at the top right of the page etc.
totisjosema 14 hours ago [-]
Will take a look, should already be there during a game though
geooff_ 13 hours ago [-]
I "Lost" to Jev while getting 10/10 questions and it got 8/10. Interesting scoring?
drivers99 12 hours ago [-]
I wonder if they fixed it, or if it depends on the game type. In Versus mode, I got 10/10, Jev got 7/10, but the points were closer: 1201 to 1034 so I assume time is also part of the calculation. One of mine was 9.6 seconds vs 0.3 seconds. It wasn't always clear where you were supposed to click, like on a graph, the choices were buttons at the bottom of the screen.
totisjosema 12 hours ago [-]
Its a combination of time and correct/wrong answer. But the game had not been played by these many people before so it can be that the scoring mechanism is not fully calibrated. Thanks for trying it out!
TZubiri 11 hours ago [-]
Too late, we've already replaced online image and video moderation with Jev, get with the times.
12 hours ago [-]
AuthAuth 11 hours ago [-]
I went in thinking I was going to cook Jev and then I get asked things like "pick the ginko leaf". Good site
totisjosema 11 hours ago [-]
haha, wait until you get asked which is a dolphin
darepublic 11 hours ago [-]
Tbf jev should also be required to use vision on the UI to decide where to click to proceed with the quiz
darepublic 12 hours ago [-]
Nice site. I assume vibecoded but it was tasteful and performant on mobile. Thanks for open sourcing it
totisjosema 12 hours ago [-]
Thanks! Yeah built with claude code.
felix089 9 hours ago [-]
I beat Jev, but jeez the leaderboard is pretty competitive...
totisjosema 9 hours ago [-]
Good job, there are some insane scores, you already better than the majority of us
inerte 14 hours ago [-]
I got a lot of answers wrong (half of them maybe?), and the ones I got it right Jev was still faster.
totisjosema 14 hours ago [-]
Play some more you will get the hang of it :)
The first 200 cards I did: Jev got 160 right, at a median of 261 ms , so no need to feel bad
edaemon 14 hours ago [-]
Interesting. Jev is certainly faster but it was wrong quite a bit more than I was.
totisjosema 14 hours ago [-]
yeah the different games play to different strengths, you can play multiplayer with friends also
arm32 12 hours ago [-]
Just like a coin flip!
totisjosema 11 hours ago [-]
A coin flip with 80% chance of success tho (and 100% in some categories)
TZubiri 12 hours ago [-]
Couple of bugs:
1- I got 7/10, jev got 6/10, and it says Jev won, presumably because I took 100 seconds, but Jev took 60? Funny what that reveals about author and AI-optimism in general
2- The chess board challenge isn't clear on how it should take the answer, I tried dragging a piece but that didn't work, then I tried touching the piece I wanted to move, but it marked the answer wrong, I apparently had to touch the square I needed to move the piece to.
totisjosema 11 hours ago [-]
Jev did not take 60 seconds for sure, with answers in 200-300 ms averages, more like 2 seconds.
You get very high scores if you are fast and accurate (which Jev is most of the time), and you get punished hard (15s) if you are wrong.
The game balances speed and accuracy.
Will try to improve the cards that didnt work for you, thanks for the feedback!
TZubiri 10 hours ago [-]
It's technically subjective, but to me speed is a tiebreaker, it goes after the decimal point. Being right is more important than being fast.
There's notably no button for "I don't know", but if there were, a human would maybe get 7 rights and 3 I don't know. While Jev would probably get 6 rights and 4 wrongs. I get that it's a game, but it's also not.
I think great minds make great efforts to not be wrong, someone that is never wrong is in a different category completely than something that answers fast, or even that answers more correct questions.
ajjenkins 11 hours ago [-]
I was confused by the chess board question too. But I do think the question is worded correctly—it’s just a little unintuitive.
semiquaver 12 hours ago [-]
The first one I opened only gave me a single option to press and when I pressed it the app told me I was wrong and that Jev had pressed the correct button (which was invisible to me I guess?)
I saw several other questions where I pressed the right answer and the app scored me as wrong. Broken slop.
coolThingsFirst 13 hours ago [-]
Wait a minute Orca is a Dolphin?
Damn.
totisjosema 12 hours ago [-]
I failed that one as well, learn something new every day I guess
logicallee 13 hours ago [-]
This was very fun! I enjoyed playing it. Thanks for sharing.
totisjosema 12 hours ago [-]
Thanks for trying it out!
casey2 13 hours ago [-]
I thought I did terrible 5, but jev got 0 in a row. then the slopcoded app says "Jev has won 2,613 of 3,300 games, this one included."
Though if you need very quick answers obviously humans can't compete.
Actually on further thought after getting 15, if you've seen the exact problem before you can answer quickly, so the usefulness is diminished to problems that don't need to be 100% correct, need to be solved very quickly (even routing might not need to be this quick), problem form often changes, but is still general knowledge, and very low marginal benifet for 99% correctness over 50%
totisjosema 12 hours ago [-]
Jev gets around 70-80% right. Varies a lot per category. But its quite surprising that its soo good in some of them
A simple system would be something like: - accuracy is most important - if tied on accuracy (ie both got 8/10) then tie break is done on speed
In general, across a lot of games - winning is a big determinant in who comes back. Right now it might be very difficult to beat JEV with the way your scoring is setup.
For my game in particular it's like a 47% chance that a winning player returns versus just 10% for non-winners.
Versus Measures accuracy but under time pressure, if you score more than Jev you will win.
And streak is also accuracy.
This quiz game, is supposed to visualize how good and bad these type of models are. They can be very fast but they can also fail 20% of the times. As a human, can you beat that?
It’s obviously much faster than a human, but it’s interesting that it only got 7/10 right on both rounds (same as me). I’m wondering what Jev could be trusted to do reliably given these results.
I guess it wasn’t optimized for these types of trivia questions. Or maybe the image capabilities are too new and need refinement.
Jev and decision models, can make decisions very fast, in this quiz with around 80% accuracy, each use case will need to define if its good enough or not.
1- I got 7/10, jev got 6/10, and it says Jev won, presumably because I took 100 seconds, but Jev took 60? Funny what that reveals about author and AI-optimism in general
2- The chess board challenge isn't clear on how it should take the answer, I tried dragging a piece but that didn't work, then I tried touching the piece I wanted to move, but it marked the answer wrong, I apparently had to touch the square I needed to move the piece to.
You get very high scores if you are fast and accurate (which Jev is most of the time), and you get punished hard (15s) if you are wrong. The game balances speed and accuracy.
Will try to improve the cards that didnt work for you, thanks for the feedback!
There's notably no button for "I don't know", but if there were, a human would maybe get 7 rights and 3 I don't know. While Jev would probably get 6 rights and 4 wrongs. I get that it's a game, but it's also not.
I think great minds make great efforts to not be wrong, someone that is never wrong is in a different category completely than something that answers fast, or even that answers more correct questions.
I saw several other questions where I pressed the right answer and the app scored me as wrong. Broken slop.
Damn.
Though if you need very quick answers obviously humans can't compete.
Actually on further thought after getting 15, if you've seen the exact problem before you can answer quickly, so the usefulness is diminished to problems that don't need to be 100% correct, need to be solved very quickly (even routing might not need to be this quick), problem form often changes, but is still general knowledge, and very low marginal benifet for 99% correctness over 50%