from nltk.book import *
*** Introductory Examples for the NLTK Book *** Loading text1, ..., text9 and sent1, ..., sent9 Type the name of the text or sentence to view it. Type: 'texts()' or 'sents()' to list the materials. text1: Moby Dick by Herman Melville 1851 text2: Sense and Sensibility by Jane Austen 1811 text3: The Book of Genesis text4: Inaugural Address Corpus text5: Chat Corpus text6: Monty Python and the Holy Grail text7: Wall Street Journal text8: Personals Corpus text9: The Man Who Was Thursday by G . K . Chesterton 1908
text1
<Text: Moby Dick by Herman Melville 1851>
text4
<Text: Inaugural Address Corpus>
text2
<Text: Sense and Sensibility by Jane Austen 1811>
text1.concordance("monstrous")
Displaying 11 of 11 matches: ong the former , one was of a most monstrous size . ... This came towards us , ON OF THE PSALMS . " Touching that monstrous bulk of the whale or ork we have r ll over with a heathenish array of monstrous clubs and spears . Some were thick d as you gazed , and wondered what monstrous cannibal and savage could ever hav that has survived the flood ; most monstrous and most mountainous ! That Himmal they might scout at Moby Dick as a monstrous fable , or still worse and more de th of Radney .'" CHAPTER 55 Of the Monstrous Pictures of Whales . I shall ere l ing Scenes . In connexion with the monstrous pictures of whales , I am strongly ere to enter upon those still more monstrous stories of them which are to be fo ght have been rummaged out of this monstrous cabinet there is no telling . But of Whale - Bones ; for Whales of a monstrous size are oftentimes cast up dead u
text1.concordance("vivid")
Displaying 9 of 9 matches: indeed , literally justified by his vivid aspect , when seen gliding at high n ammock by exhausting and intolerably vivid dreams of the night , which , resumi yet they have nothing like a fixed , vivid conception of those perils , and the mpanions of this figure were of that vivid , tiger - yellow complexion peculiar se allusions of his were at times so vivid and life - like , that they would ca ern , the Pequod at last shot by the vivid green Cockatoo Point on the Sumatra s of effulgences . That unblinkingly vivid Japanese sun seems the blazing focus denly admonished to vigilance by the vivid lightning that had just been darting others , shading their eyes from the vivid sunlight , sat far out on the rockin
text3.concordance("lived")
Displaying 25 of 38 matches: ay when they were created . And Adam lived an hundred and thirty years , and be ughters : And all the days that Adam lived were nine hundred and thirty yea and nd thirty yea and he died . And Seth lived an hundred and five years , and bega ve years , and begat Enos : And Seth lived after he begat Enos eight hundred an welve years : and he died . And Enos lived ninety years , and begat Cainan : An years , and begat Cainan : And Enos lived after he begat Cainan eight hundred ive years : and he died . And Cainan lived seventy years and begat Mahalaleel : rs and begat Mahalaleel : And Cainan lived after he begat Mahalaleel eight hund years : and he died . And Mahalaleel lived sixty and five years , and begat Jar s , and begat Jared : And Mahalaleel lived after he begat Jared eight hundred a and five yea and he died . And Jared lived an hundred sixty and two years , and o years , and he begat Eno And Jared lived after he begat Enoch eight hundred y and two yea and he died . And Enoch lived sixty and five years , and begat Met ; for God took him . And Methuselah lived an hundred eighty and seven years , , and begat Lamech . And Methuselah lived after he begat Lamech seven hundred nd nine yea and he died . And Lamech lived an hundred eighty and two years , an ch the LORD hath cursed . And Lamech lived after he begat Noah five hundred nin naan shall be his servant . And Noah lived after the flood three hundred and fi xad two years after the flo And Shem lived after he begat Arphaxad five hundred at sons and daughters . And Arphaxad lived five and thirty years , and begat Sa ars , and begat Salah : And Arphaxad lived after he begat Salah four hundred an begat sons and daughters . And Salah lived thirty years , and begat Eber : And y years , and begat Eber : And Salah lived after he begat Eber four hundred and begat sons and daughters . And Eber lived four and thirty years , and begat Pe y years , and begat Peleg : And Eber lived after he begat Peleg four hundred an
text2.concordance("affection")
Displaying 25 of 79 matches: , however , and , as a mark of his affection for the three girls , he left them t . It was very well known that no affection was ever supposed to exist between deration of politeness or maternal affection on the side of the former , the tw d the suspicion -- the hope of his affection for me may warrant , without impru hich forbade the indulgence of his affection . She knew that his mother neither rd she gave one with still greater affection . Though her late conversation wit can never hope to feel or inspire affection again , and if her home be uncomfo m of the sense , elegance , mutual affection , and domestic comfort of the fami , and which recommended him to her affection beyond every thing else . His soci ween the parties might forward the affection of Mr . Willoughby , an equally st the most pointed assurance of her affection . Elinor could not be surprised at he natural consequence of a strong affection in a young and ardent mind . This opinion . But by an appeal to her affection for her mother , by representing t every alteration of a place which affection had established as perfect with hi e will always have one claim of my affection , which no other can possibly shar f the evening declared at once his affection and happiness . " Shall we see you ause he took leave of us with less affection than his usual behaviour has shewn ness ." " I want no proof of their affection ," said Elinor ; " but of their en onths , without telling her of his affection ;-- that they should part without ould be the natural result of your affection for her . She used to be all unres distinguished Elinor by no mark of affection . Marianne saw and listened with i th no inclination for expense , no affection for strangers , no profession , an till distinguished her by the same affection which once she had felt no doubt o al of her confidence in Edward ' s affection , to the remembrance of every mark was made ? Had he never owned his affection to yourself ?" " Oh , no ; but if
text4.concordance("god")
Displaying 25 of 108 matches: eliance on the protection of Almighty God , I shall forthwith commence the duti humble , acknowledged dependence upon God and His overruling providence . We ha great office I must humbly invoke the God of our fathers for wisdom and firmnes d the same Bible and pray to the same God , and each invokes His aid against th hat any men should dare to ask a just God ' s assistance in wringing their brea offenses which , in the providence of God , must needs come , but which , havin butes which the believers in a living God always ascribe to Him ? Fondly do we war may speedily pass away . Yet , if God wills that it continue until all the r all , with firmness in the right as God gives us to see the right , let us st the prayers of the nation to Almighty God in behalf of this consummation . Fell r , they have " followed the light as God gave them to see the light ." They ar ess their fathers and their fathers ' God that the Union was preserved , that s the support and blessings of Almighty God . Fellow citizens , in the presence o ng the power and goodness of Almighty God , who presides over the destiny of na expect the favor and help of Almighty God -- that He will give to me wisdom , s suggestion to enterprise and labor . God has placed upon our head a diadem and urn than the pledge I now give before God and these witnesses of unreserved and han human life can escape the laws of God and nature . Manifestly nothing is mo and invoking the guidance of Almighty God . Our faith teaches that there is no re is no safer reliance than upon the God of our fathers , who has so singularl e the direction and favor of Almighty God . I should shrink from the duties thi devolve upon it , and in the fear of God will " take occasion by the hand and citizens and the aid of the Almighty God in the discharge of my responsible du our heartstrings like some air out of God ' s own presence , where justice and forward - looking men , to my side . God helping me , I will not fail them , i
text4.concordance("Almighty God")
no matches
text5.concordance("lol")
Displaying 25 of 822 matches: ast PART 24 / m boo . 26 / m and sexy lol U115 boo . JOIN PART he drew a girl w ope he didnt draw a penis PART ewwwww lol & a head between her legs JOIN JOIN s a bowl i got a blunt an a bong ...... lol JOIN well , glad it worked out my cha e " PART Hi U121 in ny . ACTION would lol @ U121 . . . but appearently she does 30 make sure u buy a nice ring for U6 lol U7 Hi U115 . ACTION isnt falling for didnt ya hear !!!! PART JOIN geeshhh lol U6 PART hes deaf ppl here dont get it es nobody here i wanna misbeahve with lol JOIN so read it . thanks U7 .. Im hap ies want to chat can i talk to him !! lol U121 !!! forwards too lol JOIN ALL PE k to him !! lol U121 !!! forwards too lol JOIN ALL PErvs ... redirect to U121 ' loves ME the most i love myself JOIN lol U44 how do u know that what ? jerkett ng wrong ... i can see it in his eyes lol U20 = fiance Jerketts lmao wtf yah I cooler by the minute what 'd I miss ? lol noo there too much work ! why not ?? that mean I want you ? U6 hello room lol U83 and this .. has been the grammar the rule he 's in PM land now though lol ah ok i wont bug em then someone wann flight to hell :) lmao bbl maybe PART LOL lol U7 it was me , U83 hahah U83 ! 80 ht to hell :) lmao bbl maybe PART LOL lol U7 it was me , U83 hahah U83 ! 808265 082653953 K-Fed got his ass kicked .. Lol . ACTION laughs . i got a first class . i got a first class ticket to hell lol U7 JOIN any texas girls in here ? any . whats up U155 i was only kidding . lol he 's a douchebag . Poor U121 i 'm bo ??? sits with U30 Cum to my shower . lol U121 . ACTION U1370 watches his nads ur nad with a stick . ca u U23 ewwww lol *sniffs* ewwwwww PART U115 ! owww spl ACTION is resisting . ur female right lol U115 beeeeehave Remember the LAst tim pm's me . charge that is 1.99 / min . lol @ innocent hahah lol .... yeah LOLOLO is 1.99 / min . lol @ innocent hahah lol .... yeah LOLOLOLLL U12 thats not nic s . lmao no U115 Check my record . :) Lol lick em U7 U23 how old r u lol Way to
text1.similar("monstrous")
true contemptible christian abundant few part mean careful puzzled mystifying passing curious loving wise doleful gamesome singular delightfully perilous fearless
text2.similar("monstrous")
very so exceedingly heartily a as good great extremely remarkably sweet vast amazingly
text1.similar("monstrous")
true contemptible christian abundant few part mean careful puzzled mystifying passing curious loving wise doleful gamesome singular delightfully perilous fearless
#to examine just the contexts that are shared by two or more words, such as monstrous and very
text2.common_contexts(["monstrous", "very"])
am_glad a_pretty a_lucky is_pretty be_glad
text2.similar("beautiful")
pretty by long large respectable good great s young important considerable is little keen tender quiet considered stout serious richer
text9.common_contexts(["beautiful", "important"])
No common contexts were found
text4.dispersion_plot(["citizens", "democracy", "freedom", "duties", "America"])
/usr/local/lib/python3.7/dist-packages/nltk/draw/__init__.py:15: UserWarning: nltk.draw package not loaded (please install Tkinter library).
warnings.warn("nltk.draw package not loaded (please install Tkinter library).")
--------------------------------------------------------------------------- ImportError Traceback (most recent call last) /usr/local/lib/python3.7/dist-packages/numpy/core/__init__.py in <module> 21 try: ---> 22 from . import multiarray 23 except ImportError as exc: /usr/local/lib/python3.7/dist-packages/numpy/core/multiarray.py in <module> 11 ---> 12 from . import overrides 13 from . import _multiarray_umath /usr/local/lib/python3.7/dist-packages/numpy/core/overrides.py in <module> 6 ----> 7 from numpy.core._multiarray_umath import ( 8 add_docstring, implement_array_function, _get_implementing_args) ImportError: libf77blas.so.3: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: ImportError Traceback (most recent call last) /usr/local/lib/python3.7/dist-packages/nltk/draw/dispersion.py in dispersion_plot(text, words, ignore_case, title) 25 try: ---> 26 from matplotlib import pylab 27 except ImportError as e: /usr/local/lib/python3.7/dist-packages/matplotlib/__init__.py in <module> 106 # definitions, so it is safe to import from it here. --> 107 from . import _api, cbook, docstring, rcsetup 108 from matplotlib.cbook import MatplotlibDeprecationWarning, sanitize_sequence /usr/local/lib/python3.7/dist-packages/matplotlib/cbook/__init__.py in <module> 27 ---> 28 import numpy as np 29 /usr/local/lib/python3.7/dist-packages/numpy/__init__.py in <module> 149 --> 150 from . import core 151 from .core import * /usr/local/lib/python3.7/dist-packages/numpy/core/__init__.py in <module> 47 __version__, exc) ---> 48 raise ImportError(msg) 49 finally: ImportError: IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE! Importing the numpy C-extensions failed. This error can happen for many reasons, often due to issues with your setup or how NumPy was installed. We have compiled some common reasons and troubleshooting tips at: https://numpy.org/devdocs/user/troubleshooting-importerror.html Please note and check the following: * The Python version is: Python3.7 from "/usr/bin/python3" * The NumPy version is: "1.21.2" and make sure that they are the versions you expect. Please carefully study the documentation linked above for further help. Original error was: libf77blas.so.3: cannot open shared object file: No such file or directory The above exception was the direct cause of the following exception: ValueError Traceback (most recent call last) /tmp/ipykernel_8027/2208355114.py in <module> ----> 1 text4.dispersion_plot(["citizens", "democracy", "freedom", "duties", "America"]) /usr/local/lib/python3.7/dist-packages/nltk/text.py in dispersion_plot(self, words) 550 from nltk.draw import dispersion_plot 551 --> 552 dispersion_plot(self, words) 553 554 def _train_default_ngram_lm(self, tokenized_sents, n=3): /usr/local/lib/python3.7/dist-packages/nltk/draw/dispersion.py in dispersion_plot(text, words, ignore_case, title) 29 "The plot function requires matplotlib to be installed." 30 "See http://matplotlib.org/" ---> 31 ) from e 32 33 text = list(text) ValueError: The plot function requires matplotlib to be installed.See http://matplotlib.org/
text3.generate()
Building ngram index...
laid by her , and said unto Cain , Where art thou , and said , Go to , I will not do it for ten ' s sons ; we dreamed each man according to their generatio the firstborn said unto Laban , Because I said , Nay , but Sarah shall her name be . , duke Elah , duke Shobal , and Akan . and looked upon my affliction . Bashemath Ishmael ' s blood , but Isra for as a prince hast thou found of all the cattle in the valley , and the wo The
"laid by her , and said unto Cain , Where art thou , and said , Go to ,\nI will not do it for ten ' s sons ; we dreamed each man according to\ntheir generatio the firstborn said unto Laban , Because I said , Nay ,\nbut Sarah shall her name be . , duke Elah , duke Shobal , and Akan .\nand looked upon my affliction . Bashemath Ishmael ' s blood , but Isra\nfor as a prince hast thou found of all the cattle in the valley , and\nthe wo The"
text2.generate()
Building ngram index...
knew , had by this remembrance , and if , by rapid degrees , so long . , she could live without one another , and in her rambles . at least the last evening of a brother , could you know , from the first . Dashwood ? this gentleman himself , and must put up with a kindness which they are very much vexed at , for it -- and I shall keep it entirely . admire it ; and it is , explain the grounds , or if any place could give her ease , was a
'knew , had by this remembrance , and if , by rapid degrees , so long .\n, she could live without one another , and in her rambles . at least\nthe last evening of a brother , could you know , from the first .\nDashwood ? this gentleman himself , and must put up with a kindness\nwhich they are very much vexed at , for it -- and I shall keep it\nentirely . admire it ; and it is , explain the grounds , or if any\nplace could give her ease , was a'
print(text1.generate()) * 2
Building ngram index...
long , from one to the top - mast , and no coffin and went out a sea captain -- this peaking of the whales . , so as to preserve all his might had in former years abounding with them , they toil with their lances , strange tales of Southern whaling . at once the bravest Indians he was , after in vain strove to pierce the profundity . ? then ?" a levelled flame of pale , And give no chance , watch him ; though the line , it is to be gainsaid . have been long , from one to the top - mast , and no coffin and went out a sea captain -- this peaking of the whales . , so as to preserve all his might had in former years abounding with them , they toil with their lances , strange tales of Southern whaling . at once the bravest Indians he was , after in vain strove to pierce the profundity . ? then ?" a levelled flame of pale , And give no chance , watch him ; though the line , it is to be gainsaid . have been
--------------------------------------------------------------------------- TypeError Traceback (most recent call last) /tmp/ipykernel_8027/887456320.py in <module> ----> 1 print(text1.generate()) * 2 TypeError: unsupported operand type(s) for *: 'NoneType' and 'int'
print((text1.generate()) * 2)
long , from one to the top - mast , and no coffin and went out a sea captain -- this peaking of the whales . , so as to preserve all his might had in former years abounding with them , they toil with their lances , strange tales of Southern whaling . at once the bravest Indians he was , after in vain strove to pierce the profundity . ? then ?" a levelled flame of pale , And give no chance , watch him ; though the line , it is to be gainsaid . have been long , from one to the top - mast , and no coffin and went out a sea captain -- this peaking of the whales . , so as to preserve all his might had in former years abounding with them , they toil with their lances , strange tales of Southern whaling . at once the bravest Indians he was , after in vain strove to pierce the profundity . ? then ?" a levelled flame of pale , And give no chance , watch him ; though the line , it is to be gainsaid . have beenlong , from one to the top - mast , and no coffin and went out a sea captain -- this peaking of the whales . , so as to preserve all his might had in former years abounding with them , they toil with their lances , strange tales of Southern whaling . at once the bravest Indians he was , after in vain strove to pierce the profundity . ? then ?" a levelled flame of pale , And give no chance , watch him ; though the line , it is to be gainsaid . have been
len(text1)
260819
len(text2)
141576
len(text3)
44764
len(text4)
149797
sorted(set(text3))
['!',
"'",
'(',
')',
',',
',)',
'.',
'.)',
':',
';',
';)',
'?',
'?)',
'A',
'Abel',
'Abelmizraim',
'Abidah',
'Abide',
'Abimael',
'Abimelech',
'Abr',
'Abrah',
'Abraham',
'Abram',
'Accad',
'Achbor',
'Adah',
'Adam',
'Adbeel',
'Admah',
'Adullamite',
'After',
'Aholibamah',
'Ahuzzath',
'Ajah',
'Akan',
'All',
'Allonbachuth',
'Almighty',
'Almodad',
'Also',
'Alvah',
'Alvan',
'Am',
'Amal',
'Amalek',
'Amalekites',
'Ammon',
'Amorite',
'Amorites',
'Amraphel',
'An',
'Anah',
'Anamim',
'And',
'Aner',
'Angel',
'Appoint',
'Aram',
'Aran',
'Ararat',
'Arbah',
'Ard',
'Are',
'Areli',
'Arioch',
'Arise',
'Arkite',
'Arodi',
'Arphaxad',
'Art',
'Arvadite',
'As',
'Asenath',
'Ashbel',
'Asher',
'Ashkenaz',
'Ashteroth',
'Ask',
'Asshur',
'Asshurim',
'Assyr',
'Assyria',
'At',
'Atad',
'Avith',
'Baalhanan',
'Babel',
'Bashemath',
'Be',
'Because',
'Becher',
'Bedad',
'Beeri',
'Beerlahairoi',
'Beersheba',
'Behold',
'Bela',
'Belah',
'Benam',
'Benjamin',
'Beno',
'Beor',
'Bera',
'Bered',
'Beriah',
'Bethel',
'Bethlehem',
'Bethuel',
'Beware',
'Bilhah',
'Bilhan',
'Binding',
'Birsha',
'Bless',
'Blessed',
'Both',
'Bow',
'Bozrah',
'Bring',
'But',
'Buz',
'By',
'Cain',
'Cainan',
'Calah',
'Calneh',
'Can',
'Cana',
'Canaan',
'Canaanite',
'Canaanites',
'Canaanitish',
'Caphtorim',
'Carmi',
'Casluhim',
'Cast',
'Cause',
'Chaldees',
'Chedorlaomer',
'Cheran',
'Cherubims',
'Chesed',
'Chezib',
'Come',
'Cursed',
'Cush',
'Damascus',
'Dan',
'Day',
'Deborah',
'Dedan',
'Deliver',
'Diklah',
'Din',
'Dinah',
'Dinhabah',
'Discern',
'Dishan',
'Dishon',
'Do',
'Dodanim',
'Dothan',
'Drink',
'Duke',
'Dumah',
'Earth',
'Ebal',
'Eber',
'Edar',
'Eden',
'Edom',
'Edomites',
'Egy',
'Egypt',
'Egyptia',
'Egyptian',
'Egyptians',
'Ehi',
'Elah',
'Elam',
'Elbethel',
'Eldaah',
'EleloheIsrael',
'Eliezer',
'Eliphaz',
'Elishah',
'Ellasar',
'Elon',
'Elparan',
'Emins',
'En',
'Enmishpat',
'Eno',
'Enoch',
'Enos',
'Ephah',
'Epher',
'Ephra',
'Ephraim',
'Ephrath',
'Ephron',
'Er',
'Erech',
'Eri',
'Es',
'Esau',
'Escape',
'Esek',
'Eshban',
'Eshcol',
'Ethiopia',
'Euphrat',
'Euphrates',
'Eve',
'Even',
'Every',
'Except',
'Ezbon',
'Ezer',
'Fear',
'Feed',
'Fifteen',
'Fill',
'For',
'Forasmuch',
'Forgive',
'From',
'Fulfil',
'G',
'Gad',
'Gaham',
'Galeed',
'Gatam',
'Gather',
'Gaza',
'Gentiles',
'Gera',
'Gerar',
'Gershon',
'Get',
'Gether',
'Gihon',
'Gilead',
'Girgashites',
'Girgasite',
'Give',
'Go',
'God',
'Gomer',
'Gomorrah',
'Goshen',
'Guni',
'Hadad',
'Hadar',
'Hadoram',
'Hagar',
'Haggi',
'Hai',
'Ham',
'Hamathite',
'Hamor',
'Hamul',
'Hanoch',
'Happy',
'Haran',
'Hast',
'Haste',
'Have',
'Havilah',
'Hazarmaveth',
'Hazezontamar',
'Hazo',
'He',
'Hear',
'Heaven',
'Heber',
'Hebrew',
'Hebrews',
'Hebron',
'Hemam',
'Hemdan',
'Here',
'Hereby',
'Heth',
'Hezron',
'Hiddekel',
'Hinder',
'Hirah',
'His',
'Hitti',
'Hittite',
'Hittites',
'Hivite',
'Hobah',
'Hori',
'Horite',
'Horites',
'How',
'Hul',
'Huppim',
'Husham',
'Hushim',
'Huz',
'I',
'If',
'In',
'Irad',
'Iram',
'Is',
'Isa',
'Isaac',
'Iscah',
'Ishbak',
'Ishmael',
'Ishmeelites',
'Ishuah',
'Isra',
'Israel',
'Issachar',
'Isui',
'It',
'Ithran',
'Jaalam',
'Jabal',
'Jabbok',
'Jac',
'Jachin',
'Jacob',
'Jahleel',
'Jahzeel',
'Jamin',
'Japhe',
'Japheth',
'Jared',
'Javan',
'Jebusite',
'Jebusites',
'Jegarsahadutha',
'Jehovahjireh',
'Jemuel',
'Jerah',
'Jetheth',
'Jetur',
'Jeush',
'Jezer',
'Jidlaph',
'Jimnah',
'Job',
'Jobab',
'Jokshan',
'Joktan',
'Jordan',
'Joseph',
'Jubal',
'Judah',
'Judge',
'Judith',
'Kadesh',
'Kadmonites',
'Karnaim',
'Kedar',
'Kedemah',
'Kemuel',
'Kenaz',
'Kenites',
'Kenizzites',
'Keturah',
'Kiriathaim',
'Kirjatharba',
'Kittim',
'Know',
'Kohath',
'Kor',
'Korah',
'LO',
'LORD',
'Laban',
'Lahairoi',
'Lamech',
'Lasha',
'Lay',
'Leah',
'Lehabim',
'Lest',
'Let',
'Letushim',
'Leummim',
'Levi',
'Lie',
'Lift',
'Lo',
'Look',
'Lot',
'Lotan',
'Lud',
'Ludim',
'Luz',
'Maachah',
'Machir',
'Machpelah',
'Madai',
'Magdiel',
'Magog',
'Mahalaleel',
'Mahalath',
'Mahanaim',
'Make',
'Malchiel',
'Male',
'Mam',
'Mamre',
'Man',
'Manahath',
'Manass',
'Manasseh',
'Mash',
'Masrekah',
'Massa',
'Matred',
'Me',
'Medan',
'Mehetabel',
'Mehujael',
'Melchizedek',
'Merari',
'Mesha',
'Meshech',
'Mesopotamia',
'Methusa',
'Methusael',
'Methuselah',
'Mezahab',
'Mibsam',
'Mibzar',
'Midian',
'Midianites',
'Milcah',
'Mishma',
'Mizpah',
'Mizraim',
'Mizz',
'Moab',
'Moabites',
'Moreh',
'Moreover',
'Moriah',
'Muppim',
'My',
'Naamah',
'Naaman',
'Nahath',
'Nahor',
'Naphish',
'Naphtali',
'Naphtuhim',
'Nay',
'Nebajoth',
'Neither',
'Night',
'Nimrod',
'Nineveh',
'Noah',
'Nod',
'Not',
'Now',
'O',
'Obal',
'Of',
'Oh',
'Ohad',
'Omar',
'On',
'Onam',
'Onan',
'Only',
'Ophir',
'Our',
'Out',
'Padan',
'Padanaram',
'Paran',
'Pass',
'Pathrusim',
'Pau',
'Peace',
'Peleg',
'Peniel',
'Penuel',
'Peradventure',
'Perizzit',
'Perizzite',
'Perizzites',
'Phallu',
'Phara',
'Pharaoh',
'Pharez',
'Phichol',
'Philistim',
'Philistines',
'Phut',
'Phuvah',
'Pildash',
'Pinon',
'Pison',
'Potiphar',
'Potipherah',
'Put',
'Raamah',
'Rachel',
'Rameses',
'Rebek',
'Rebekah',
'Rehoboth',
'Remain',
'Rephaims',
'Resen',
'Return',
'Reu',
'Reub',
'Reuben',
'Reuel',
'Reumah',
'Riphath',
'Rosh',
'Sabtah',
'Sabtech',
'Said',
'Salah',
'Salem',
'Samlah',
'Sarah',
'Sarai',
'Saul',
'Save',
'Say',
'Se',
'Seba',
'See',
'Seeing',
'Seir',
'Sell',
'Send',
'Sephar',
'Serah',
'Sered',
'Serug',
'Set',
'Seth',
'Shalem',
'Shall',
'Shalt',
'Shammah',
'Shaul',
'Shaveh',
'She',
'Sheba',
'Shebah',
'Shechem',
'Shed',
'Shel',
'Shelah',
'Sheleph',
'Shem',
'Shemeber',
'Shepho',
'Shillem',
'Shiloh',
'Shimron',
'Shinab',
'Shinar',
'Shobal',
'Should',
'Shuah',
'Shuni',
'Shur',
'Sichem',
'Siddim',
'Sidon',
'Simeon',
'Sinite',
'Sitnah',
'Slay',
'So',
'Sod',
'Sodom',
'Sojourn',
'Some',
'Spake',
'Speak',
'Spirit',
'Stand',
'Succoth',
'Surely',
'Swear',
'Syrian',
'Take',
'Tamar',
'Tarshish',
'Tebah',
'Tell',
'Tema',
'Teman',
'Temani',
'Terah',
'Thahash',
'That',
'The',
'Then',
'There',
'Therefore',
'These',
'They',
'Thirty',
'This',
'Thorns',
'Thou',
'Thus',
'Thy',
'Tidal',
'Timna',
'Timnah',
'Timnath',
'Tiras',
'To',
'Togarmah',
'Tola',
'Tubal',
'Tubalcain',
'Twelve',
'Two',
'Unstable',
'Until',
'Unto',
'Up',
'Upon',
'Ur',
'Uz',
'Uzal',
'We',
'What',
'When',
'Whence',
'Where',
'Whereas',
'Wherefore',
'Which',
'While',
'Who',
'Whose',
'Whoso',
'Why',
'Wilt',
'With',
'Woman',
'Ye',
'Yea',
'Yet',
'Zaavan',
'Zaphnathpaaneah',
'Zar',
'Zarah',
'Zeboiim',
'Zeboim',
'Zebul',
'Zebulun',
'Zemarite',
'Zepho',
'Zerah',
'Zibeon',
'Zidon',
'Zillah',
'Zilpah',
'Zimran',
'Ziphion',
'Zo',
'Zoar',
'Zohar',
'Zuzims',
'a',
'abated',
'abide',
'able',
'abode',
'abomination',
'about',
'above',
'abroad',
'absent',
'abundantly',
'accept',
'accepted',
'according',
'acknowledged',
'activity',
'add',
'adder',
'afar',
'afflict',
'affliction',
'afraid',
'after',
'afterward',
'afterwards',
'aga',
'again',
'against',
'age',
'aileth',
'air',
'al',
'alive',
'all',
'almon',
'alo',
'alone',
'aloud',
'also',
'altar',
'altogether',
'always',
'am',
'among',
'amongst',
'an',
'and',
'angel',
'angels',
'anger',
'angry',
'anguish',
'anointedst',
'anoth',
'another',
'answer',
'answered',
'any',
'anything',
'appe',
'appear',
'appeared',
'appease',
'appoint',
'appointed',
'aprons',
'archer',
'archers',
'are',
'arise',
'ark',
'armed',
'arms',
'army',
'arose',
'arrayed',
'art',
'artificer',
'as',
'ascending',
'ash',
'ashamed',
'ask',
'asked',
'asketh',
'ass',
'assembly',
'asses',
'assigned',
'asswaged',
'at',
'attained',
'audience',
'avenged',
'aw',
'awaked',
'away',
'awoke',
'back',
'backward',
'bad',
'bade',
'badest',
'badne',
'bak',
'bake',
'bakemeats',
'baker',
'bakers',
'balm',
'bands',
'bank',
'bare',
'barr',
'barren',
'basket',
'baskets',
'battle',
'bdellium',
'be',
'bear',
'beari',
'bearing',
'beast',
'beasts',
'beautiful',
'became',
'because',
'become',
'bed',
'been',
'befall',
'befell',
'before',
'began',
'begat',
'beget',
'begettest',
'begin',
'beginning',
'begotten',
'beguiled',
'beheld',
'behind',
'behold',
'being',
'believed',
'belly',
'belong',
'beneath',
'bereaved',
'beside',
'besides',
'besought',
'best',
'betimes',
'better',
'between',
'betwixt',
'beyond',
'binding',
'bird',
'birds',
'birthday',
'birthright',
'biteth',
'bitter',
'blame',
'blameless',
'blasted',
'bless',
'blessed',
'blesseth',
'blessi',
'blessing',
'blessings',
'blindness',
'blood',
'blossoms',
'bodies',
'boldly',
'bondman',
'bondmen',
'bondwoman',
'bone',
'bones',
'book',
'booths',
'border',
'borders',
'born',
'bosom',
'both',
'bottle',
'bou',
'boug',
'bough',
'bought',
'bound',
'bow',
'bowed',
'bowels',
'bowing',
'boys',
'bracelets',
'branches',
'brass',
'bre',
'breach',
'bread',
'breadth',
'break',
'breaketh',
'breaking',
'breasts',
'breath',
'breathed',
'breed',
'brethren',
'brick',
'brimstone',
'bring',
'brink',
'broken',
'brook',
'broth',
'brother',
'brought',
'brown',
'bruise',
'budded',
'build',
'builded',
'built',
'bulls',
'bundle',
'bundles',
'burdens',
'buried',
'burn',
'burning',
'burnt',
'bury',
'buryingplace',
'business',
'but',
'butler',
'butlers',
'butlership',
'butter',
'buy',
'by',
'cakes',
'calf',
'call',
'called',
'came',
'camel',
'camels',
'camest',
'can',
'cannot',
'canst',
'captain',
'captive',
'captives',
'carcases',
'carried',
'carry',
'cast',
'castles',
'catt',
'cattle',
'caught',
'cause',
'caused',
'cave',
'cease',
'ceased',
'certain',
'certainly',
'chain',
'chamber',
'change',
'changed',
'changes',
'charge',
'charged',
'chariot',
'chariots',
'chesnut',
'chi',
'chief',
'child',
'childless',
'childr',
'children',
'chode',
'choice',
'chose',
'circumcis',
'circumcise',
'circumcised',
'citi',
'cities',
'city',
'clave',
'clean',
'clear',
'cleave',
'clo',
'closed',
'clothed',
'clothes',
'cloud',
'clusters',
'co',
'coat',
'coats',
'coffin',
'cold',
...]
len(set(text3)) #counting the word types (word + punctuations) from above
2789
len(set(text3)) / len(text3) #calculating the lexical richness (each word is used 16 times aver.)
0.06230453042623537
# >> which is 6%
text3.count("smote") #how many times a specific word is used in a text
5
100 * text3.count("smote") / len(text3) #what % of the text is taken by a specific word
0.01116968992940756
text5.count("lol")
704
100 * text5.count("lol") / len(text5)
1.5640968673628082
#define a task:
def lexical_diversity(text): #variable (parameter) is text
return len(set(text)) / len(text)
def percentage(count, total): #specified to take 2 variables
return 100 * count / total
#function that merges the two activities upstairs :)
lexical_diversity(text1)
0.07406285585022564
percentage(2, 4) #the data inside - that is the argument e.g. 2, 4
50.0
percentage(text4.count('a'), len(text4)) #(how many times a specific word is used in text), (len of the whole text)
1.457973123627309