This is a read-only archive of the old Scratch 1.x Forums.
Try searching the current Scratch discussion forums.

#151 2012-05-27 03:51:01

sparks
Community Moderator
Registered: 2008-11-05
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Aw man, that sounds like a horrible amount of work gone down the drain for you, Hardmath  sad  I don't think anything that bad has ever happened to me but I feel your pain!

I'll keep an eye on this thread and see what is suggested. I quite like the idea of a tic-tac-toe game (if there is a draw, the game could be replayed till someone wins so long as each AI has at least a little randomness in their responses).


http://img541.imageshack.us/img541/7563/scratchbetabanner.png

Offline

 

#152 2012-05-27 04:26:07

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

sparks wrote:

I'll keep an eye on this thread and see what is suggested. I quite like the idea of a tic-tac-toe game (if there is a draw, the game could be replayed till someone wins so long as each AI has at least a little randomness in their responses).

Hmm... but it's not /that/ hard a game, is it? And with two reasonably proficient players, a draw is always unavoidable, isn't it?  hmm


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#153 2012-05-27 05:02:21

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

sparks wrote:

Aw man, that sounds like a horrible amount of work gone down the drain for you, Hardmath  sad  I don't think anything that bad has ever happened to me but I feel your pain!

I'll keep an eye on this thread and see what is suggested. I quite like the idea of a tic-tac-toe game (if there is a draw, the game could be replayed till someone wins so long as each AI has at least a little randomness in their responses).

This is the first time I've ever lost any data "just like that", and trust me, it feels terrible. I'm a paranoid coder who has many copies of his work all over the system just to be safe. Anyway, I guess these things happen, and I've gotta move on.  sad

So, about the actual competition: I'm not exactly sure what we're gonna do now...  hmm  Tic-Tac-Toe is too easy, Hex is too hard. We need some sort of game which needs no framework but is hard to code. Or maybe...

Here's a crazy idea (I'm good at making up crazy ideas, bear with me please): how about we code chatbots? A chatbot "game" consists of two chatbots conversing, and the first chatbot to get stuck (repeat "What?" many times, etc.) loses. Chatbots are good AI exercises: you need to implement some sort of simplistic language processing to determine the subject of the sentence input, then construct your response based on the input. The back-end would be really easy to code: just run the chatbots and print the messages out on the console. Also, it's just plain really cool to see two computers talk to each other, you know what I mean?


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#154 2012-05-27 05:03:54

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

blob8108 wrote:

sparks wrote:

I'll keep an eye on this thread and see what is suggested. I quite like the idea of a tic-tac-toe game (if there is a draw, the game could be replayed till someone wins so long as each AI has at least a little randomness in their responses).

Hmm... but it's not /that/ hard a game, is it? And with two reasonably proficient players, a draw is always unavoidable, isn't it?  hmm

The problem with TTT is it's too short, so you can make a reasonable "perfect" player which searches through the entire game. So all games would result in ties. Unless we decree that the second player wins if it's a tie, but then that's ugly.  hmm


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#155 2012-05-27 07:07:21

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Hardmath123 wrote:

Here's a crazy idea (I'm good at making up crazy ideas, bear with me please): how about we code chatbots? A chatbot "game" consists of two chatbots conversing, and the first chatbot to get stuck (repeat "What?" many times, etc.) loses. Chatbots are good AI exercises: you need to implement some sort of simplistic language processing to determine the subject of the sentence input, then construct your response based on the input. The back-end would be really easy to code: just run the chatbots and print the messages out on the console. Also, it's just plain really cool to see two computers talk to each other, you know what I mean?

How about a Turing Testbig_smile

I love chatbots. They're fun to play with/code. The best ones probably need some kind of learning element (like Cleverbot does). I hooked up a simple learning chatbot of my own design to an anonymous chatroom once, where it learnt to reply to what people said from what strangers said in reply to it (if you see what I meant). It was highly amusing  big_smile

I'm not sure if JS would still be an appropriate language for this — perhaps allow any language, from Python to C to Scratch/BYOB, and communicate using a really simple socket interface? ie. write sentences separated by newlines to the socket, and recieve replies in the same format. It'd be reasonably easy to add Mesh support, too. I imagine those who still wanted to use JS could use something like node.js.

I even have a Twisted/Python/HTML/JS/CSS chat interface somewhere, which could be useful.

Persumably there'd be some kind of central server...

So, those are my thoughts — what d'you think?  smile

Last edited by blob8108 (2012-05-27 07:09:03)


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#156 2012-05-27 07:18:28

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Oh, and since you were worried about people finding it too difficult — we should allow the use of frameworks like AIML that make writing chatbots as simple as writing a list of rules like

Code:

<category>
<pattern>ARE YOU A CABBAGE</pattern>
<template>
No I am an artificial intelligence.
</template>
</category>

(taken from the standard-aiml package)

Also libraries like NLTK (which contains Wordnet) should be allowed.

Also this looks interesting...

Last edited by blob8108 (2012-05-27 07:29:11)


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#157 2012-05-27 08:00:28

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

So, you liked the chatbot idea?  tongue

I like your suggestion about coding in any language: we'd support BYOB, JavaScript, and Objective-C/C. I have my own evil ways to socket connect with JS and BYOB is easy with remote sensor connections. I'd incorporate the (Obj-)C code into the BackEnd. So that takes care of the communications. I want to keep it simple so that we don't need any fancy server gunk, just a single Mac application will suffice. I'm a proficient Xcoder, I can have the Mac system up and running by June 1. Great idea!  smile

Let's see how the others (sparks, roijac) like the idea.


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#158 2012-05-27 09:57:33

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Hardmath123 wrote:

So, you liked the chatbot idea?  tongue

...no, not at all.  tongue

It's kinda an interest of mine, I guess...

I like your suggestion about coding in any language: we'd support BYOB, JavaScript, and Objective-C/C.

AND PYTHON

I have my own evil ways to socket connect with JS and BYOB is easy with remote sensor connections. I'd incorporate the (Obj-)C code into the BackEnd. So that takes care of the communications. I want to keep it simple so that we don't need any fancy server gunk, just a single Mac application will suffice. I'm a proficient Xcoder, I can have the Mac system up and running by June 1. Great idea!  smile

The "server gunk" is really not that difficult, methinks  tongue  You can have a really simple protocol (just read input lines off a socket, and send your reply).  smile

How about a Linux VPS (I still have a free ec2 instance somewhere) that hosts everyone's chatbots, and a (Python  tongue ) server that judges/runs the test. You could invite people to connect, talk to a random chatbot/human, and choose whether they thought the other guy was human or not. Then you could see whose chatbot was most human!


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#159 2012-05-27 10:10:48

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Have a play with this, for example! This is the Twisted/Python/HTML/JS/CSS chat interface I mentioned, hooked up to the simple learning chatbot. Have fun!  big_smile

(Warning: he's rather slightly crazy/rude/offensive...  tongue )

Last edited by blob8108 (2012-05-27 10:11:34)


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#160 2012-05-27 10:20:50

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

@whoever: don't say I didn't warn you  tongue


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#161 2012-05-27 11:37:59

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

blob8108 wrote:

Hardmath123 wrote:

So, you liked the chatbot idea?  tongue

...no, not at all.  tongue

It's kinda an interest of mine, I guess...

...

back to the drawing board

...

tongue

I like your suggestion about coding in any language: we'd support BYOB, JavaScript, and Objective-C/C.

AND PYTHON

If you do the Python socket coding; I don't know Python.

I have my own evil ways to socket connect with JS and BYOB is easy with remote sensor connections. I'd incorporate the (Obj-)C code into the BackEnd. So that takes care of the communications. I want to keep it simple so that we don't need any fancy server gunk, just a single Mac application will suffice. I'm a proficient Xcoder, I can have the Mac system up and running by June 1. Great idea!  smile

The "server gunk" is really not that difficult, methinks  tongue  You can have a really simple protocol (just read input lines off a socket, and send your reply).  smile

Why have a server when you can do without it?  hmm

How about a Linux VPS (I still have a free ec2 instance somewhere) that hosts everyone's chatbots, and a (Python  tongue ) server that judges/runs the test. You could invite people to connect, talk to a random chatbot/human, and choose whether they thought the other guy was human or not. Then you could see whose chatbot was most human!

Umm... I'm not sure you can judge on a scale of "humanness" that accurately.

Last edited by Hardmath123 (2012-05-27 11:38:38)


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#162 2012-05-27 11:50:43

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

How would the contest work, then? I don't understand...

I was just thinking you'd do something like a Turing test. Like the Loebner Prize, or something.

Hardmath123 wrote:

blob8108 wrote:

Hardmath123 wrote:

So, you liked the chatbot idea?  tongue

...no, not at all.  tongue

It's kinda an interest of mine, I guess...

...

back to the drawing board

...

tongue

I don't get it D: What are you saying about me?  tongue


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#163 2012-05-27 12:04:18

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

blob8108 wrote:

How would the contest work, then? I don't understand...

I was just thinking you'd do something like a Turing test. Like the Loebner Prize, or something.

Hardmath123 wrote:

blob8108 wrote:

...no, not at all.  tongue

It's kinda an interest of mine, I guess...

...

back to the drawing board

...

tongue

I don't get it D: What are you saying about me?  tongue

I was responding to "...no, not at all". I guess I should have cut out the second line.

EDIT: So, seriously, you agree with the idea, right? Now I'm really confused...  tongue

Last edited by Hardmath123 (2012-05-27 12:05:41)


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#164 2012-05-27 12:09:13

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Anyway, about how the contest works (assuming people like the chatbot idea, of course):

I like the idea of a Turing Test, except I feel we're not really going to get such high-level chatbots; a bit of JS crunched up in two weeks isn't going to fool anyone. I think a better way would be to put two chatbots against each other, and run say 10 speeches by each; then judge which bot spoke better by a simple Rubric which we can come up with together. For example, they could be graded on how accurately they answered questions posed to them by the other bot.


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#165 2012-05-27 13:10:50

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Hardmath123 wrote:

blob8108 wrote:

Hardmath123 wrote:


...

back to the drawing board

...

tongue

I don't get it D: What are you saying about me?  tongue

I was responding to "...no, not at all". I guess I should have cut out the second line.

Ah, that makes much more sense.  tongue

EDIT: So, seriously, you agree with the idea, right? Now I'm really confused...  tongue

Yes. Yes, I do.  tongue

I like the idea of a Turing Test, except I feel we're not really going to get such high-level chatbots; a bit of JS crunched up in two weeks isn't going to fool anyone.

I think a better way would be to put two chatbots against each other, and run say 10 speeches by each; then judge which bot spoke better by a simple Rubric which we can come up with together. For example, they could be graded on how accurately they answered questions posed to them by the other bot.

Ah, but the subjectivity! :'( Coming up with a way to judge them would be really difficult...

I suppose you could have multiple categories (elegance, amusingness, convincingness) and everyone who takes part, or just anyone, could vote for their favourite in each category. Or something like that.  smile

It's a thought!


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#166 2012-05-27 13:48:19

suneel
Scratcher
Registered: 2012-01-27
Posts: 96

Re: AI Strategy Tournament: Rescheduled to June 1st

Hardmath123 wrote:

Since nobody is really enthusiastic (or confident, whichever way you put it) about doing it on their own, how about we make 2 teams instead? Then slinger can join, too, AND I don't have to set up matches (which I personally find a very unfair way to host a tournament, since often I get stuck with the top players in the first rounds)!

Also, if I'm not mistaken, the current "maybe"s are:

blob8108
sparks
rookwood101
bobbybee
roijac

Hardmath123, if you think it would be fair. I'll release the "pit against" script publicly, so anyone can rerun the match on their own to double-check.

As far as the game goes, how about Hex? You play on a grid of tesselated hexagons, taking turns coloring hexagons red or blue depending on your team. Winner is the first person to get a continuous line of hexagons of his color from one edge of the board to the other.

Nice button Hardmath123. How did u get it?

Last edited by suneel (2012-05-27 13:50:30)


Get Gangnam Style for free!
getgangnamforfree.weebly.co­­m

Offline

 

#167 2012-05-27 13:49:21

suneel
Scratcher
Registered: 2012-01-27
Posts: 96

Re: AI Strategy Tournament: Rescheduled to June 1st

I'm planning on making my own board game. Any ideas?
I'm trying to make it in scratch, bulb or panther.
How do u get a signature?

Last edited by suneel (2012-05-27 13:52:54)


Get Gangnam Style for free!
getgangnamforfree.weebly.co­­m

Offline

 

#168 2012-05-27 14:03:55

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

suneel wrote:

How do u get a signature?

Click "Profile" at the top, and choose "Personality" from the menu on the left.  smile


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#169 2012-05-27 23:05:18

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

suneel wrote:

Hardmath123 wrote:

Since nobody is really enthusiastic (or confident, whichever way you put it) about doing it on their own, how about we make 2 teams instead? Then slinger can join, too, AND I don't have to set up matches (which I personally find a very unfair way to host a tournament, since often I get stuck with the top players in the first rounds)!

Also, if I'm not mistaken, the current "maybe"s are:

blob8108
sparks
rookwood101
bobbybee
roijac

Hardmath123, if you think it would be fair. I'll release the "pit against" script publicly, so anyone can rerun the match on their own to double-check.

As far as the game goes, how about Hex? You play on a grid of tesselated hexagons, taking turns coloring hexagons red or blue depending on your team. Winner is the first person to get a continuous line of hexagons of his color from one edge of the board to the other.

Nice button Hardmath123. How did u get it?

Code:

[quote]button contents[/quote]

Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#170 2012-05-28 00:19:55

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

blob8108 wrote:

Hardmath123 wrote:

blob8108 wrote:


I don't get it D: What are you saying about me?  tongue

I was responding to "...no, not at all". I guess I should have cut out the second line.

Ah, that makes much more sense.  tongue

EDIT: So, seriously, you agree with the idea, right? Now I'm really confused...  tongue

Yes. Yes, I do.  tongue

Whew.

I like the idea of a Turing Test, except I feel we're not really going to get such high-level chatbots; a bit of JS crunched up in two weeks isn't going to fool anyone.

I think a better way would be to put two chatbots against each other, and run say 10 speeches by each; then judge which bot spoke better by a simple Rubric which we can come up with together. For example, they could be graded on how accurately they answered questions posed to them by the other bot.

Ah, but the subjectivity! :'( Coming up with a way to judge them would be really difficult...

I suppose you could have multiple categories (elegance, amusingness, convincingness) and everyone who takes part, or just anyone, could vote for their favourite in each category. Or something like that.  smile

It's a thought!

Good idea! I could post the transcripts on the forums, and we could take a vote.


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#171 2012-05-28 00:51:35

amcerbu
Scratcher
Registered: 2009-07-21
Posts: 500+

Re: AI Strategy Tournament: Rescheduled to June 1st

Hmm...  I'm not so sure about a chatbot AI.  It seems like most of them are learning-based, so how would you measure whether the competition was fair?  Suppose one chatbot had an entire year of "experience" talking to people, and another one didn't.  I still like the idea of an AI for a game.  I don't think Chess is within our capabilities, but I like the idea of some simple board game like Checkers, Reversi, or Go.

Offline

 

#172 2012-05-28 01:44:13

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

Yeah, but a game needs lots of coding for the back-end and frameworks. Besides, chatbots' data will be cleared each time I set up a conversation, so I don't see that as a problem.


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#173 2012-05-28 01:47:14

amcerbu
Scratcher
Registered: 2009-07-21
Posts: 500+

Re: AI Strategy Tournament: Rescheduled to June 1st

Is the chatbot talking to another chatbot, or to a human?  blob8108 mentioned a "turing test," where a third party looks at a log of a conversation and tries to determine which speaker is human and which is computer.  If he gets it wrong, you've got a really good AI.

Offline

 

#174 2012-05-28 01:52:51

Hardmath123
Scratcher
Registered: 2010-02-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

I vote for bot-on-bot rather than bot-on-human, because creating fair human responses to dynamically generated questions by a chatbot is not possible. Besides, imagine how cool it would be to have two programs have a conversation!  big_smile


Hardmaths-MacBook-Pro:~ Hardmath$ sudo make $(whoami) a sandwich

Offline

 

#175 2012-05-28 06:16:57

roijac
Scratcher
Registered: 2010-01-19
Posts: 1000+

Re: AI Strategy Tournament: Rescheduled to June 1st

blob8108 wrote:

AND PYTHON

hell yeah!  smile

don't really like chatbots, what do you say about infinite tic-tac-toe board where you need to make a row of 5?

Offline

 

Board footer