excel - Naive Bayes Ticket Classification Python -

-

i have csv export our ticketing system 2 columns.

short description , class.

both created agent when logging ticket. eg

  • data backup not working,backup
  • email change in groups,notes
  • backup directory not found,backup
  • email > global - lotus notes,notes

i have been asked write naive bayes program using python read short description in csv file , decide how should classified.

i have 329 tickets have been classified 6 different classes.

the following count of each:

  • class1 60
  • class2 77
  • class3 65
  • class4 16
  • class5 18
  • class6 93

i thinking have create 6 different dictionaries (one each class) containing words used in short description, excluding usual !"£$%^&*()<>,./?:;@'#~][{}

then when run program tokenize short description using nltk , compare dictionaries , whatever 1 has highest matches determine class.

am going right way? how many tickets should using sample?

the following have @ moment. runs through csv file named after class , outputs file punctuation removed, words in lower case , in separate cells. data used dictionary. i'm not sure if i'm going whole thing right way though.

import csv nltk.tokenize import regexptokenizer   #read csv readfile = open ('backup.csv', 'r') csv.readfile = csv.reader(readfile)  resultfile = open ('result.csv', 'w') wr = csv.writer(resultfile)  #removes punctuation tokenizer = regexptokenizer(r'\w+')  #for every row in file tokenize , covert lowercase #write tokenized words .csv file. row in csv.readfile:     wr.writerow(tokenizer.tokenize(row[0].lower()))  readfile.close() resultfile.close()

edit: have started using following takes in data 2 column csv file:

from textblob.classifiers import naivebayesclassifier textblob import textblob  open('train.csv', 'r') fp:      cl = naivebayesclassifier(fp, format="csv")  print(cl.classify("backup"))  # "backup" print(cl.classify("lotus notes."))   #"lotus" etc..

pretty sure need better sample size of training , test data , feed in csv of short descriptions update class has been calculated.

from functionality point of view seems work unless i've made glaring mistakes?


Comments

Post a Comment

Popular posts from this blog

c# - Where does the .ToList() go in LINQ query result -

-
when getting data populate data grid, have pulled data, made list , mapped model, this: public list<person> getpeople() { var data = _db.person.tolist(); list<person> people = new list<person>(); foreach (var item in data) { person person = new person() { personid = item.personid, firstname = item.firstname, lastname = item.lastname }; people.add(person); } return people; } this works fine, in interest of writing less code discovered .select method , (what think is) anonymous type. have: public list<person> getpeople() { return _db.person.select(d => new person { personid = item.personid, firstname = item.firstname, lastname = item.lastname }).tolist(); } though not easy read, works fine too. there preference either way? ...
Read more

android - CollapsingToolbarLayout: position the ExpandedText programmatically -

-
i using new android support design view collapsingtoolbarlayout. have need position expandedtitle programmatically. actually way set position expandedtitle in .xml file (example here: https://goo.gl/l5h5fc ) there no public api set text position programmatically , fields private . do know if it's possible without reflection or 'hacky' tricks? i have solved problem exposing properties via reflection ( https://gist.github.com/fpezzato/8e7d45112883dbbc5ffb ), works don't use trick in production code. @google: please no more private or final stuff! :)
Read more

Listeners to visualise results of load test in JMeter -

-
i want run load test in non-gui mode , save results in .csv file. (i have not modified .properties files, standard information saved) i plan load file , visualise results jmeter’s listeners. which listeners suited purpose? should avoid @ cost, might cause me misinterpret information? (e.g. in view results tree response data empty have - - not saved this. however, there has in fact been response. if saw listener might think there hasn’t been one. since want avoid this, listeners have gain information needed .csv file.) i’d know both jmeter listeners plugins. if running test in non-ui mode ideally should disable listeners in script. use '-l' option store test results .jtl extension. can later open jtl file jmeter. aggregate report or summary report should summarize test results , response time , throughput. if want plot graphs see trends on test duration can use http://jmeter-plugins.org/#/ standard , lib set. i suggest following listeners: response ...
Read more