java - Exporting Data from cassandra to mongodb -

-

i have program exports data directly cassandra mongodb.it works fine but, doesn't copies counter type column cassandra mongodb. leaves blank.

public class export  { static string keyspace = "db1"; static string table = "results"; static string host = "localhost";  @suppresswarnings("deprecation") static mongo mongo = new mongo("localhost", 27017); @suppresswarnings("deprecation") static db db = mongo.getdb("mydb");  static dbcollection collection = db.getcollection("results");  public static void main( string[] args ) throws ioexception {      cluster.builder clusterbuilder = cluster.builder()      .addcontactpoints(host);      cluster cluster = clusterbuilder.build();      session session = cluster.connect(keyspace);       statement stmt = new simplestatement("select * " + table);      stmt.setfetchsize(1);      resultset rs = session.execute(stmt);      iterator<row> iter = rs.iterator();       arraylist<string> colname = new arraylist<string>();      row row1 = iter.next();      if (row1 != null)      {          (definition key1 : row1.getcolumndefinitions().aslist())          {                        string val = key1.getname();                  colname.add(val);          }       }       while (!rs.isfullyfetched())       {          rs.fetchmoreresults();          row row = iter.next();          if (row != null)          {   basicdbobject document = new basicdbobject();              arraylist<string> ele = new arraylist<string>();              (definition key : row.getcolumndefinitions().aslist())              {                    string val = mygetvalue(key, row);                  ele.add(val);              }               (int = 0; < ele.size() && < colname.size(); i++) {                      document.put(colname.get(i), ele.get(i));                 }                      collection.insert(document);          }      }          session.close();         cluster.close();   }      public static string mygetvalue(definition key, row row)      {         string str = "";          if (key != null)         {             string col = key.getname();              try             {                 if (key.gettype() == datatype.cdouble())                 {                     str = new double(row.getdouble(col)).tostring();                 }                 else if (key.gettype() == datatype.cint())                 {                     str = new integer(row.getint(col)).tostring();                 }                 else if (key.gettype() == datatype.uuid())                 {                     str = row.getuuid(col).tostring();                 }                 else if (key.gettype() == datatype.cfloat())                 {                     str = new float(row.getfloat(col)).tostring();                 }                 else if (key.gettype() == datatype.counter())                 {                     str = new float(row.getfloat(col)).tostring();                 }                  else if (key.gettype() == datatype.timestamp())                 {                     str = row.getdate(col).tostring();                      simpledateformat fmt = new simpledateformat("yyyy-mm-dd hh:mm:ssz");                     str = fmt.format(row.getdate(col));                 }                 else                 {                     str = row.getstring(col);                 }             } catch (exception e)                 {                     str = "";                 }          }                  return str;        }      }

and data gets exported mongodb :

{ "_id" : objectid("558c0202209c02284d30df05"), "term" : "gamma red eye tennis dampener", "year" : "2015", "month" : "05", "day" : "29", "hour" : "09", "dayofyear" : "176", "weekofyear" : "26", "productcount" : "1", "count" : "" } { "_id" : objectid("558c0202209c02284d30df06"), "term" : "headtie", "year" : "2015", "month" : "06", "day" : "01", "hour" : "05", "dayofyear" : "176", "weekofyear" : "26", "productcount" : "29", "count" : "" } { "_id" : objectid("558c0202209c02284d30df07"), "term" : "dryed roller court", "year" : "2015", "month" : "06", "day" : "08", "hour" : "15", "dayofyear" : "176", "weekofyear" : "26", "productcount" : "362", "count" : ""  }

i know problem is.the function below not inserting value of counter mongodb since val defined string conflicts counter data type of cassandra.

while (!rs.isfullyfetched())       {          rs.fetchmoreresults();          row row = iter.next();          if (row != null)          {   basicdbobject document = new basicdbobject();              arraylist<string> ele = new arraylist<string>();              (definition key : row.getcolumndefinitions().aslist())              {                    string val = mygetvalue(key, row);                  system.out.println(val);                  ele.add(val);              }               (int = 0; < ele.size() && < colname.size(); i++) {                      document.put(colname.get(i), ele.get(i));                 }                      collection.insert(document);          }      }

can please suggest required change need in function?

you should use getlong() instead of getfloat() retrieve counter value, i.e. change code:

else if (key.gettype() == datatype.counter()) {      str = new float(row.getfloat(col)).tostring(); }

to 

else if (key.gettype() == datatype.counter()) {      str = string.valueof(row.getlong(col)); }

btw pay attention on fact not have create instance of wrapper type long (as did int cases). use string.valueof() create string representation of value.


Comments

Post a Comment

Popular posts from this blog

c# - Where does the .ToList() go in LINQ query result -

-
when getting data populate data grid, have pulled data, made list , mapped model, this: public list<person> getpeople() { var data = _db.person.tolist(); list<person> people = new list<person>(); foreach (var item in data) { person person = new person() { personid = item.personid, firstname = item.firstname, lastname = item.lastname }; people.add(person); } return people; } this works fine, in interest of writing less code discovered .select method , (what think is) anonymous type. have: public list<person> getpeople() { return _db.person.select(d => new person { personid = item.personid, firstname = item.firstname, lastname = item.lastname }).tolist(); } though not easy read, works fine too. there preference either way? ...
Read more

android - CollapsingToolbarLayout: position the ExpandedText programmatically -

-
i using new android support design view collapsingtoolbarlayout. have need position expandedtitle programmatically. actually way set position expandedtitle in .xml file (example here: https://goo.gl/l5h5fc ) there no public api set text position programmatically , fields private . do know if it's possible without reflection or 'hacky' tricks? i have solved problem exposing properties via reflection ( https://gist.github.com/fpezzato/8e7d45112883dbbc5ffb ), works don't use trick in production code. @google: please no more private or final stuff! :)
Read more

Listeners to visualise results of load test in JMeter -

-
i want run load test in non-gui mode , save results in .csv file. (i have not modified .properties files, standard information saved) i plan load file , visualise results jmeter’s listeners. which listeners suited purpose? should avoid @ cost, might cause me misinterpret information? (e.g. in view results tree response data empty have - - not saved this. however, there has in fact been response. if saw listener might think there hasn’t been one. since want avoid this, listeners have gain information needed .csv file.) i’d know both jmeter listeners plugins. if running test in non-ui mode ideally should disable listeners in script. use '-l' option store test results .jtl extension. can later open jtl file jmeter. aggregate report or summary report should summarize test results , response time , throughput. if want plot graphs see trends on test duration can use http://jmeter-plugins.org/#/ standard , lib set. i suggest following listeners: response ...
Read more