I need a List of All known english words.

[sebgg]

So just a little project I want to do, see the longest/most frequent word in a massive (several billion characters) list of seemingly random letters. so need alist of known words to compare to.

wondered if anyone has one compiled already or if anyone knows where i could get a hold of one?

Cheers,

Sebastian.

[Mat]

http://www.manythings.org/vocabulary/lists/l/

I imagine you may want to find a better way to store them... And I'd do a lot of reading into string search algorithms (the one I know of is by three guys, one called pratt). I'd also consider another language other than AutoIt (not something I suggest very often ). Given that the task is pretty simple, avoiding the overhead you'll get with AutoIt should be easy.

Edited November 28, 2011 by Mat

[Melba23]

sebgg,

You cannot be arsed to search - why should we?

But you might want to click here.

M23

Edit: typo.

Edited November 28, 2011 by Melba23

[GEOSoft]

Just follow the link to my website and you will find it on there in both zip and txt formats.

It's in the Miscellaneous section.

Edited November 28, 2011 by GEOSoft

[sebgg]

sebgg,

You cannot be arsed to search - why should we?

But you might want to click here.

M23

Edit: typo.

because then i wouldnt have the chance to chat to all you lovely people!

thanks all for help. in the end went with a 17x,xxx word list space separated, perfect!

sebs

[GEOSoft]

If there are only 170K of words it's no where near complete.

EDIT: Out of curiosity where did you find your word list (link)? Every time I find a new list I just merge it into mine. Sometimes I actually find a few words that are missing from my list.

Edited November 28, 2011 by GEOSoft

[kylomas]

GEOSoft,

If there are only 170K of words it's no where near complete.

The list at your site has appx 121K words...what would you consider a complete list?

kylomas

[Mat]

You could circumbobulate and obambulate around this topic, but it would be a case of acrasia. You are better off aucupating... Let's face it, any dictionary is going to be macilent, given that our language is motatorious.

It's all rather ostrobogulous... (pandiculates due to delassation). I imagine this would be a good topic for a deipnosophist though

[kylomas]

Thank you, Mat, precicely what I was thinking.

kylomas

[Thornhunt]

You could circumbobulate and obambulate around this topic, but it would be a case of acrasia. You are better off aucupating... Let's face it, any dictionary is going to be macilent, given that our language is motatorious.

It's all rather ostrobogulous... (pandiculates due to delassation). I imagine this would be a good topic for a deipnosophist though

i think my avatar pretty much summed up my face when i read this... Edited November 29, 2011 by Thornhunt

[sebgg]

If there are only 170K of words it's no where near complete.

EDIT: Out of curiosity where did you find your word list (link)? Every time I find a new list I just merge it into mine. Sometimes I actually find a few words that are missing from my list.

i went with this as it was longer than the one on your webpage, but combining them might add afew i have no idea.

and yes 170k is far from complete but its a nice start for fun.

http://homepage.ntlworld.com/adam.bozon/Dictionary.htm

seb

[GEOSoft]

Damn! I thought I had updated that file.

It should be just over 188K words and should not include any single character words since it was written to update my wifes Scrabble program.

I'll update it in a few minutes.

EDIT: It's been updated.

I also have a copy of the list that does include single character words if you need it.

I know what happened with that origional list too; It only included words that my script was able to verify on a couple of dictionary sites.

I knew that when I was working on the script I was over 188K words because I remember mentioning that figure to SmOke_N at the time in an IM.

Edited November 29, 2011 by GEOSoft

[BrewManNH]

You can also check this site for a word list that might be of use. I looked at the SCOWL list and there's over 290,000 lines in the list, but there's a lot of words that are plural versions, or possessives of other words in the list so it might take some culling to get a good list out of it.

[GEOSoft]

It will take a lot of culling since it also contains things like Acer which is a tree genus and would not normally be included in a word list.

Thanks for the link though. I'll run through them with a different script and see if I can add any to my list.

[GEOSoft]

@BrewManNH

Thanks to a link I found via that page you linked to. My new list is 255,329 words. I'll be uploading it later today.

Thanks

[BrewManNH]

I think the Oxford English Dictionary only has that many words in it.

[GEOSoft]

Probably correct but with thousands or even tens of thousands of wordlists available it takes time to generate a new one. Every once in a while I come across another list that is worth checking and this time it was thanks to you.

[sebgg]

cheers geo, ill try with the updated word list youve got,

thanks all for help

Seb

[Chimaera]

i think my avatar pretty much summed up my face when i read this...

I think i need to temporarily borrow your avatar too

[Sn3akyP3t3]

It seems like your compiled list of words is quite massive and this information may no longer assist you, but check out the spell check dictionaries and language packs provided by the Mozilla foundation. The en-US dictionary consists of around 62,000 words that you may find don't exist in your list.

Also, what are you using to compare and import text so duplicates are not brought in?