This is a read-only archive of the old Scratch 1.x Forums.
Try searching the current Scratch discussion forums.

#1 2012-05-29 10:30:44

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Safety for 2.0

I've seen a lot of people get exited over the whole new cloud variables and list system. Sounds pretty cool. But then I think of how unsafe it is, someone could say ANYTHING they wanted with a project like this. In the AT there is a project which brings up the idea of having the creator assign moderators. But this would still leave the problem of, having the moderators, who would be assigned by the creator rather than the ST, see the words and things said.

So then someone brings up 'Auto censors'. WOW! Great idea, you could have a list of all the bad words and things close to it or with *'s in it, and just have it delete any words which have those words in it! But then we can all see how this would go wrong when someone presses the 'see inside button' and sees the list of bad words.

So what do we do? People have suggested a block before which would basically auto sensor any bad words, but, as this is a good idea, the creator of a project might not use this when making a chat system.

Now we see that the solution is have it forced in. Have a auto sensor built into the cloud variables, and lists! For best results the ST should make it so it would go to a site page or something which would have a blacklist, that way the ST could update it for corrections. (Remember all those things that had to be added for the comments' blacklist?)

I notice that there isn't really a reason to go against this, as it is just like censoring the comments, and it is something that needs to be done, and also for some reason I thought I remembered the ST mentioning something like that at some time... so If this idea has already been implemented, just tell me.  tongue

Thanks ST for keeping Scratch a safe website!


For:
zippynk
Pecola1
mythbusteranimator
scimonster
RedRocker227
schusteralex2
Bklecka
technoboy10
berberberber
slinger
muppetds
jvvg
Cozyhut3
wolvesstar97
fetchydog567
trinary

Against: (now who would be against safety?  tongue )
ManaUser (for now)

Last edited by Pecola1 (2012-06-13 21:58:00)


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#2 2012-05-29 10:40:14

zippynk
Scratcher
Registered: 2011-07-23
Posts: 500+

Re: Safety for 2.0

Yessssssss

Support!


https://dl.dropbox.com/u/60598636/trifocal_interlude_soundcloud_button.png

Offline

 

#3 2012-05-29 10:46:04

mythbusteranimator
Scratcher
Registered: 2012-02-28
Posts: 1000+

Re: Safety for 2.0

support


http://www.foxtrot.com/comics/2012-04-01-fdb37077.gif
clicky

Offline

 

#4 2012-05-29 11:11:06

scimonster
Community Moderator
Registered: 2010-06-13
Posts: 1000+

Offline

 

#5 2012-05-29 11:43:14

RedRocker227
Scratcher
Registered: 2011-10-26
Posts: 1000+

Re: Safety for 2.0

Yep.


Why

Offline

 

#6 2012-05-29 11:52:17

schusteralex2
Scratcher
Registered: 2011-09-17
Posts: 1000+

Re: Safety for 2.0

Support.


http://i44.tinypic.com/2uj37ds.gif

Offline

 

#7 2012-05-29 12:35:03

Bklecka
Scratcher
Registered: 2011-08-27
Posts: 1000+

Re: Safety for 2.0

Support


http://i48.tinypic.com/106ijc9.jpg

Offline

 

#8 2012-05-29 13:02:51

ManaUser
Scratcher
Registered: 2009-03-11
Posts: 100+

Re: Safety for 2.0

I don't like the idea of auto-censoring all cloud variables at all.

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

A related problem is exactly how this censorship should work. It would need to happen in a way that doesn't break the project. The simplest would be to completely ignore commands that would add a bad word to the cloud. But this would cause huge trouble.  Suppose you had two lists:

Code:

Bob     How's it going?
Lisa    Nice day to today.
Tony    Not here, it's raining. :(
Bob     I like turtles.
Tony    I prefer gophers.
Jamie   Turtles scare me.

But what if Lisa had said something bad and it got deleted?
Then it would turn  into:

Code:

Bob     How's it going?
Lisa    Not here, it's raining. :(
Tony    I like turtles.
Bob     I prefer gophers.
Tony    Turtles scare me.
Jamie

Which makes no sense. A slightly better option would be to make it blank, rather than delete it, but an unexpected empty variable could still mess up a project. Replacing only the offensive word itself with asterisks would be the least likely to break things, but it woulds still cause very serious problems if the variable actually contained save data or something.

For all those reasons, I think providing blocks for detecting and/or censoring offensive words is a much option than trying to do it totally automatically.


http://i.imgur.com/SPYSM.gif http://i.imgur.com/t9k1Z.gif http://i.imgur.com/OwYVa.gif http://i.imgur.com/0qlZq.gif

Offline

 

#9 2012-05-29 13:20:32

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

ManaUser wrote:

I don't like the idea of auto-censoring all cloud variables at all.

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

A related problem is exactly how this censorship should work. It would need to happen in a way that doesn't break the project. The simplest would be to completely ignore commands that would add a bad word to the cloud. But this would cause huge trouble.  Suppose you had two lists:

Code:

Bob     How's it going?
Lisa    Nice day to today.
Tony    Not here, it's raining. :(
Bob     I like turtles.
Tony    I prefer gophers.
Jamie   Turtles scare me.

But what if Lisa had said something bad and it got deleted?
Then it would turn  into:

Code:

Bob     How's it going?
Lisa    Not here, it's raining. :(
Tony    I like turtles.
Bob     I prefer gophers.
Tony    Turtles scare me.
Jamie

Which makes no sense. A slightly better option would be to make it blank, rather than delete it, but an unexpected empty variable could still mess up a project. Replacing only the offensive word itself with asterisks would be the least likely to break things, but it woulds still cause very serious problems if the variable actually contained save data or something.

For all those reasons, I think providing blocks for detecting and/or censoring offensive words is a much option than trying to do it totally automatically.

Providing the block would only allow the user who made the game to put it in, whereas it should be required.

Also by deleted i mean it would do something to replace it, for instance: [Censored] or [Content Deleted] it wouldn't actually delete the item of the list or the variable.  smile

And as for that code thing your working on, if the code includes a bad word how often do you think that would happen?  tongue  If your code uses numbers and letters, it would be very unlikely, just letters, still pretty much the same amount of likleyness. (errrrr whatevs.)

If your code does at one point have an error, it means your CODE is the fault, not the scratch teams censoring. They censor whats bad, and if your code shows something bad on accident, its your code showing something bad on accident, not the blacklist taking out something it shouldn't.  tongue


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#10 2012-05-29 13:23:29

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

ManaUser wrote:

I don't like the idea of auto-censoring all cloud variables at all.

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

A related problem is exactly how this censorship should work. It would need to happen in a way that doesn't break the project. The simplest would be to completely ignore commands that would add a bad word to the cloud. But this would cause huge trouble.  Suppose you had two lists:

Code:

Bob     How's it going?
Lisa    Nice day to today.
Tony    Not here, it's raining. :(
Bob     I like turtles.
Tony    I prefer gophers.
Jamie   Turtles scare me.

But what if Lisa had said something bad and it got deleted?
Then it would turn  into:

Code:

Bob     How's it going?
Lisa    Not here, it's raining. :(
Tony    I like turtles.
Bob     I prefer gophers.
Tony    Turtles scare me.
Jamie

Which makes no sense. A slightly better option would be to make it blank, rather than delete it, but an unexpected empty variable could still mess up a project. Replacing only the offensive word itself with asterisks would be the least likely to break things, but it woulds still cause very serious problems if the variable actually contained save data or something.

For all those reasons, I think providing blocks for detecting and/or censoring offensive words is a much option than trying to do it totally automatically.

Another thing, which is more important:

1. having your game's code which can be changed to fit the system, and having bad words posted all over cloud data because there is no way to stop it without messing up your code

or

2.having no cuss words anywhere, and having a very very small chance that your project would mess up, and even if it did you could fix it.

Chose between the two.  tongue


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#11 2012-05-29 13:36:01

slinger
Scratcher
Registered: 2011-06-21
Posts: 1000+

Re: Safety for 2.0

Brilliant idea.
Support.


http://s0.bcbits.com/img/buttons/bandcamp_130x27_blue.png

Offline

 

#12 2012-05-29 13:57:11

coolhogs
Scratcher
Registered: 2011-07-26
Posts: 1000+

Re: Safety for 2.0

Wait. If Scratch was a bad word, then they can change the word to:
Scr@tch
Scråtch

I do not support. You could just add a censor, yourself. If you can't, then it's your responsibility.


Get ready for domination of:  tongue

Offline

 

#13 2012-05-29 14:20:20

Mokat
Scratcher
Registered: 2011-12-08
Posts: 1000+

Re: Safety for 2.0

coolhogs wrote:

Wait. If Scratch was a bad word, then they can change the word to:
Scr@tch
Scråtch

I do not support. You could just add a censor, yourself. If you can't, then it's your responsibility.

+1

Last edited by Mokat (2012-05-29 15:16:24)


http://www.eggcave.com/egg/977371.pnghttp://www.eggcave.com/egg/977376.pnghttp://www.eggcave.com/egg/1005291.pnghttp://www.eggcave.com/egg/996745.png

Offline

 

#14 2012-05-29 14:56:42

technoboy10
Scratcher
Registered: 2007-08-25
Posts: 1000+

Re: Safety for 2.0

Support.


So long, 1.4.
http://goo.gl/3JEV9

Offline

 

#15 2012-05-29 15:58:42

blob8108
Scratcher
Registered: 2007-06-25
Posts: 1000+

Re: Safety for 2.0

Pecola1 wrote:

ManaUser wrote:

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

And as for that code thing your working on, if the code includes a bad word how often do you think that would happen?  tongue  If your code uses numbers and letters, it would be very unlikely, just letters, still pretty much the same amount of likleyness. (errrrr whatevs.)

If your code does at one point have an error, it means your CODE is the fault, not the scratch teams censoring. They censor whats bad, and if your code shows something bad on accident, its your code showing something bad on accident, not the blacklist taking out something it shouldn't.  tongue

I agree with ManaUser; it's not the code's "fault". For example, the level editor might pack tiles in base64 (A to z, 0 to 9, _ and -) format. If someone using the editor happened to design part of a level which happened to make a rude word when encoded, censoring it would break the game. If you replace it by asterisks, the asterisks might be ignored by the level editor; or worse, code for a completely different tile.

The point about it being unlikely is reasonable, I suppose; but the principle that there should exist certain combinations that aren't possible with the level editor —  and these arrangements are also hard to predict/determine — seems wrong.

I'm not sure it'd be that easy to fix, either. If the encoder has to anticipate/work around the filter, to avoid "accidentally" encoding a bad word, then how does it do that? Should the editor just disallow that particular arrangement of tiles? Or check the output to see if it's going to be filtered and somehow "escape" it by adding extra characters — eg \ — that are ignored on decoding?

That brings up another problem, that coolhogs points out — aren't most filters reasonably easy to avoid? For example, by adding extra characters or spaces inside the word.  hmm


Things I've made: kurt | scratchblocks2 | this cake

Offline

 

#16 2012-05-31 23:19:17

berberberber
Scratcher
Registered: 2012-03-08
Posts: 1000+

Re: Safety for 2.0

blob8108 wrote:

Pecola1 wrote:

ManaUser wrote:

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

And as for that code thing your working on, if the code includes a bad word how often do you think that would happen?  tongue  If your code uses numbers and letters, it would be very unlikely, just letters, still pretty much the same amount of likleyness. (errrrr whatevs.)

If your code does at one point have an error, it means your CODE is the fault, not the scratch teams censoring. They censor whats bad, and if your code shows something bad on accident, its your code showing something bad on accident, not the blacklist taking out something it shouldn't.  tongue

I agree with ManaUser; it's not the code's "fault". For example, the level editor might pack tiles in base64 (A to z, 0 to 9, _ and -) format. If someone using the editor happened to design part of a level which happened to make a rude word when encoded, censoring it would break the game. If you replace it by asterisks, the asterisks might be ignored by the level editor; or worse, code for a completely different tile.

The point about it being unlikely is reasonable, I suppose; but the principle that there should exist certain combinations that aren't possible with the level editor —  and these arrangements are also hard to predict/determine — seems wrong.

I'm not sure it'd be that easy to fix, either. If the encoder has to anticipate/work around the filter, to avoid "accidentally" encoding a bad word, then how does it do that? Should the editor just disallow that particular arrangement of tiles? Or check the output to see if it's going to be filtered and somehow "escape" it by adding extra characters — eg \ — that are ignored on decoding?

That brings up another problem, that coolhogs points out — aren't most filters reasonably easy to avoid? For example, by adding extra characters or spaces inside the word.  hmm

They could maybe have report button that would replace the list with: This post has been found to be inappropiate by a scratcher(s). Please leave a comment to bring the creator of this project to notice.  Thank you, and help the keep cloud clean!

By the way, I support this idea, Pecola1.

Last edited by berberberber (2012-05-31 23:20:37)


http://i47.tinypic.com/2iaa73k.png

Offline

 

#17 2012-06-01 09:50:13

scratchisthebest
Scratcher
Registered: 2009-02-08
Posts: 500+

Re: Safety for 2.0

Do not support. I like the base64 example above.

Let's say you have some data stored like gd9yug2-bSGgggyhd_b4syu. Let's pretend "ggg" was a bad word, for whatever reason. Now it would read gd9yug2-bSG[censored]yhd_b4syu. [ and ] are not base64 characters, and even if they were, there is different data where the ggg once was.

Another thing (I used to have a swear word blocker extension that would do this) is the system might mangle words like "assistance" and "peacock". (Look at the first 3 and last 4 letters.)

edit: my swear word blocker *still* mangles peacock to peac***. willfix.

Last edited by scratchisthebest (2012-06-01 09:51:37)


bye 1.4, we all loved you. but we all outgrew the site. 2.0 is a welcome change.
http://scratch.mit.edu/img/Pico3-med.pnghttp://scratch.mit.edu/img/Pico3-med.pnghttp://scratch.mit.edu/img/Pico3-med.pnghttp://scratch.mit.edu/img/Pico3-med.pnghttp://scratch.mit.edu/img/Pico3-med.png

Offline

 

#18 2012-06-01 13:42:03

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

coolhogs wrote:

Wait. If Scratch was a bad word, then they can change the word to:
Scr@tch
Scråtch

I do not support. You could just add a censor, yourself. If you can't, then it's your responsibility.

if i made a sensor the project would be deleted because it would have a bunch of bad words in the project.  tongue


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#19 2012-06-01 13:45:35

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

blob8108 wrote:

Pecola1 wrote:

ManaUser wrote:

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

And as for that code thing your working on, if the code includes a bad word how often do you think that would happen?  tongue  If your code uses numbers and letters, it would be very unlikely, just letters, still pretty much the same amount of likleyness. (errrrr whatevs.)

If your code does at one point have an error, it means your CODE is the fault, not the scratch teams censoring. They censor whats bad, and if your code shows something bad on accident, its your code showing something bad on accident, not the blacklist taking out something it shouldn't.  tongue

I agree with ManaUser; it's not the code's "fault". For example, the level editor might pack tiles in base64 (A to z, 0 to 9, _ and -) format. If someone using the editor happened to design part of a level which happened to make a rude word when encoded, censoring it would break the game. If you replace it by asterisks, the asterisks might be ignored by the level editor; or worse, code for a completely different tile.

The point about it being unlikely is reasonable, I suppose; but the principle that there should exist certain combinations that aren't possible with the level editor —  and these arrangements are also hard to predict/determine — seems wrong.

I'm not sure it'd be that easy to fix, either. If the encoder has to anticipate/work around the filter, to avoid "accidentally" encoding a bad word, then how does it do that? Should the editor just disallow that particular arrangement of tiles? Or check the output to see if it's going to be filtered and somehow "escape" it by adding extra characters — eg \ — that are ignored on decoding?

That brings up another problem, that coolhogs points out — aren't most filters reasonably easy to avoid? For example, by adding extra characters or spaces inside the word.  hmm

How do you think they censor comments? They have a blacklist wich has all of the combos, so if scratch was a bad word, they would have:
Scr4tch
Scr@tch
Scratch
Scr^tch etc


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#20 2012-06-01 13:48:14

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

scratchisthebest wrote:

Do not support. I like the base64 example above.

Let's say you have some data stored like gd9yug2-bSGgggyhd_b4syu. Let's pretend "ggg" was a bad word, for whatever reason. Now it would read gd9yug2-bSG[censored]yhd_b4syu. [ and ] are not base64 characters, and even if they were, there is different data where the ggg once was.

Another thing (I used to have a swear word blocker extension that would do this) is the system might mangle words like "assistance" and "peacock". (Look at the first 3 and last 4 letters.)

edit: my swear word blocker *still* mangles peacock to peac***. willfix.

But they can have ways of making sure that doesn't happen, in fact, if the letters where togerther, it wouldn't censor.

They have for instance:

Scratch as a bad word, but ogScratchgo would not be censored, the problem is actually the opposite!


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

#21 2012-06-01 15:25:45

muppetds
Scratcher
Registered: 2011-02-11
Posts: 1000+

Re: Safety for 2.0

i support


SCRATCH'S PARTLY INSANE RESIDENT 
http://internetometer.com/imagesmall/31691.pnghttp://bluetetrarpg.x10.mx/usercard/?name=muppetds

Offline

 

#22 2012-06-01 16:49:43

ImagineIt
Scratcher
Registered: 2011-02-28
Posts: 1000+

Re: Safety for 2.0

ManaUser wrote:

I don't like the idea of auto-censoring all cloud variables at all.

For one thing, they may not be intended as readable text. For example I'm working on a project with a level editor, eventually I want to make a version where you can publish those levels online. But the levels are stored using ASCII characters including letters. So what if a level level data just happened to contain letters that spell something rude? Should that be censored?

A related problem is exactly how this censorship should work. It would need to happen in a way that doesn't break the project. The simplest would be to completely ignore commands that would add a bad word to the cloud. But this would cause huge trouble.  Suppose you had two lists:

Code:

Bob     How's it going?
Lisa    Nice day to today.
Tony    Not here, it's raining. :(
Bob     I like turtles.
Tony    I prefer gophers.
Jamie   Turtles scare me.

But what if Lisa had said something bad and it got deleted?
Then it would turn  into:

Code:

Bob     How's it going?
Lisa    Not here, it's raining. :(
Tony    I like turtles.
Bob     I prefer gophers.
Tony    Turtles scare me.
Jamie

Which makes no sense. A slightly better option would be to make it blank, rather than delete it, but an unexpected empty variable could still mess up a project. Replacing only the offensive word itself with asterisks would be the least likely to break things, but it woulds still cause very serious problems if the variable actually contained save data or something.

For all those reasons, I think providing blocks for detecting and/or censoring offensive words is a much option than trying to do it totally automatically.

Offline

 

#23 2012-06-01 23:15:19

BLU_Spy
Scratcher
Registered: 2012-01-05
Posts: 1000+

Re: Safety for 2.0

I do not support.

It‘s a good idea, but won‘t work at all.

Imagine Scratch as a bad word. They could say:

Scraatch
Scrach
5CR4TCH
SSSSSSScraaaaaaaaaatch
hctarcs
$cr@tch

And many, many, MANY others.

Sorry, but this idea is pretty useless. x(


I HAVE SWITCHED ACCOUNTS! My new username is NoxSpooth.

Offline

 

#24 2012-06-01 23:20:40

trinary
Scratcher
Registered: 2012-01-29
Posts: 1000+

Re: Safety for 2.0

BLU_Spy wrote:

I do not support.

It‘s a good idea, but won‘t work at all.

Imagine Scratch as a bad word. They could say:

Scraatch
Scrach
5CR4TCH
SSSSSSScraaaaaaaaaatch
hctarcs
$cr@tch

And many, many, MANY others.

Sorry, but this idea is pretty useless. x(

Exactly.

There are far too many possibilities and combinations which could escape the filter.


http://trinary.tk/images/signature_.php

Offline

 

#25 2012-06-09 16:07:52

Pecola1
Scratcher
Registered: 2010-09-06
Posts: 1000+

Re: Safety for 2.0

trinary wrote:

BLU_Spy wrote:

I do not support.

It‘s a good idea, but won‘t work at all.

Imagine Scratch as a bad word. They could say:

Scraatch
Scrach
5CR4TCH
SSSSSSScraaaaaaaaaatch
hctarcs
$cr@tch

And many, many, MANY others.

Sorry, but this idea is pretty useless. x(

Exactly.

There are far too many possibilities and combinations which could escape the filter.

Then how about they remove the filter for the comments of projects?
What would that do?

EVERY little things help. The can get around it, but those who say it wont care about getting banned, otherwise they would just not say it.  tongue


If you are reading this, please read to the end, because if you don't you won't know what's at the end. Don't just skip to the end though otherwise you won't be able to read the middle, which is most important. Now you must be wondering why you just read all that, the reason is you may have not noticed something, read it again and see if you notice it this time  smile

Offline

 

Board footer