Updates from February, 2012 Toggle Comment Threads | Keyboard Shortcuts

  • Tomás Augusto Müller 2:09 pm on February 28, 2012 Permalink | Reply
    Tags: benchmark, , , , JIT, , ,   

    Benchmarking NeoQuotes (Jetty + JRubyRack) 

    To perform basic HTTP benchmarks against a web application, you can start with ab – Apache HTTP server benchmarking tool. speed

    If you use Ubuntu, the installation is very simple:

    sudo apt-get install apache2-utils

    I used this tool to benchmark NeoQuotes application, testing how Jetty with JRuby-Rack are performing against multiple concurrent requests.

    First, start up Jetty with mvn jetty:run or with the command defined in project Procfile (sh target/bin/jruby -S config/jetty.rb for NeoQuotes).

    Next, execute multiple times the following command:

    ab -n 10000 -c 25 http://localhost:8080/

    where n = number of requests and c = concurrency level.

    Is worth to look to the number of requests per second, that are increasing every time the benchmark is executed. This happens thanks to JIT!

    Below some results after running ab -n 10000 -c 25 http://localhost:55012/ three times in a commodity hardware (all tests were performed on the application homepage where there is no interaction with Neo4j and no cache mechanism is configured):

    First execution:

    Time taken for tests:   73.162 seconds
    Requests per second:    136.68 [#/sec] (mean)

    Second execution:

    Time taken for tests:   67.006 seconds
    Requests per second:    149.24 [#/sec] (mean)

    Third execution:

    Time taken for tests:   65.725 seconds
    Requests per second:    152.15 [#/sec] (mean)

    Also, take a look at Min and Max threads of Jetty QueuedThreadPool, at config/jetty.rb configuration.

    Depending of your hardware and your VM configuration,the more threads you configure into min and max, the worse your throughput gets when your VM starts to reach its resource limits.

     
  • Tomás Augusto Müller 9:41 pm on February 13, 2012 Permalink | Reply
    Tags: , heroku, , , , , , , voice interfaces   

    Talking with Neo4j Graphs 

    Hello!

    In this post I will be covering all main details regarding the development of my entry for the Neo4j Challenge.

    The main objective of this challenge is to create a Heroku-ready template or demo application using Neo4j. So, I neo4j challenge websitethought to myself: – what kind of application would be nice to show up in this contest?

    After many ideas, here it is!  neoquotes logo

    In short, the application is a Stock Exchange symbol lookup using Neo4j and your voice.

    Ok! Let me explain what I did.

    My mainly objective was try to combine all the joy of Ruby programming, with the power and ease of use provided by the awesome Spring Data Neo4j, Spring Framework and JVM, to this amazing piece of software called Neo4j which let me curious since 2011 in the Jim Webber talk at QCONSP conference of that year.qconsp 2011

    So, to start things up, JRuby comes in as a perfect fit. It also allowed me to use Sinatra to easily develop the user interface (both, voice interface and GUI). I choose Sinatra in this case because of it’s simplicity and as long the application stay small, it beat Rails (as said by @DHH).

    Jetty is another very nice (and old) project, which provides a Web server and javax.servlet container, plus support for Web Sockets, OSGi, JMX, JNDI, JASPI, AJP and many other integrations, and can be used to develop self contained applications. In this article from Heroku blog we have a nice introduction to create a Java Web Application using Jetty. Its integration with Maven was also another motivation point.

    Talking about Maven, possibly in POM.xml resides one of the trickiest parts of the application.

    After configuring all the dependencies, aspectj-maven-plugin, jetty-maven-plugin, let’s look to configuration of appassembler-maven-plugin and jruby-rake-plugin:

    jruby-rake-plugin:

    <executions>
        <execution>
            <id>install-bundler</id>
            <phase>process-resources</phase>
            <goals>
                <goal>jruby</goal>
            </goals>
            <configuration>
                <args>-S gem install bundler --no-ri --no-rdoc --install-dir vendor/bundle</args>
            </configuration>
        </execution>
        <execution>
            <id>bundle-install</id>
            <phase>process-resources</phase>
            <goals>
                <goal>jruby</goal>
            </goals>
            <configuration>
                <args>script/bundle install --without development:test</args>
            </configuration>
        </execution>
    </executions>

    As we can see, the plugin execution is responsible for download and install Bundler, then next execute the specified script witch lives in application script folder. This script basically starts Bundler client (pre-configuring ENV['GEM_HOME'], ENV['GEM_PATH'] and ENV['BUNDLE_GEMFILE']), and following the parameters, all gems except the ones for development and test, are installed.

    Last, but not least, the appassembler-maven-plugin:

    <configuration>
        <assembleDirectory>target</assembleDirectory>
        <extraJvmArguments>-Djruby.native.enabled=false -Djruby.cext.enabled=false -Djruby.compat.version=1.9 -Xmx256m -Xss2048k</extraJvmArguments>
        <programs>
            <program>
                <mainClass>org.jruby.Main</mainClass>
                <name>jruby</name>
            </program>
        </programs>
    </configuration>

    Above we have the configuration for the assemble goal execution. The trick here is to generate the executable with JRuby (org.jruby.Main) as main class. And you can also set extra JVM arguments, like the version of Ruby language to use.

    After this brief look into POM.xml, let’s see how Heroku starts Jetty. This is defined in the Procfile:

    web: sh target/bin/jruby -S config/jetty.rb

    So, that’s it! Now our app is running on Heroku Cloud! For more details take a look into /config/jetty.rb to see how Jetty is being started up and /src/main/webapp/WEB-INF/web.xml to see the JRuby-Rack configuration. Other technical details you can find at application readme file.

    Now, let’s talk about Neo4j.

    Your life is a huge graph.

    (…) and I think it can be handled by Neo4j. Back to 2011, Jim Webber let me very

    Ok... not quite a graph. But you get the idea!

    Ok... not quite a graph. But you get the idea!

    interested in Neo4j with his talk at QCONSP 2011. Maybe because in that year I was working on my final graduation project – a recommender system to support fundamental analysis of the Stock Market using natural language processing, and I never forgot of one thing that he said. More or less like this: “MapReduce processing between http requests can be very expensive! Some problems cannot be resolved with this approach.”. Well, I did this. And I must confess: a graph database would have changed a lot my project.

    So, when I discovered this challenge, I decided “- ok, now is the time to take a closer look on Neo4j.”

    First thing I did: accessed Neo4j download page and downloaded the 1.6 Community version.

    After that, the server installation. It is super easy. Just follow this instructions.

    So, what’s next step? Learn, learn and learn!

    I was able to make some initial experiments very fast after a dynamic reading of this *superb* online resource: Good Relationships: The Spring Data Neo4j Guide Book. Thank’s to Michael Hunger, David Montag, Andreas Kollegger by this material.

    Also, I learned a lot from the following links:

    And that’s it. This is the magic of open-source software. Have a doubt of how one given thing work? Go to source code and read it! All you need to get started with Neo4j is this. Trust me ; )

    Giving voice to a graph

    I used Arbor.js library to display the Neo4j data to the user. But how differently the information can be visualized? Through voice interfaces of course!

    As I already worked with Voice Interfaces some years ago (in 2008 actually, when I won the Sun Students Contest. More info here and here), this was not a mystery. Again I used VoiceXML markup language, and the free service provided by Voxeo. Refer to the links above for more information about VoiceXML.

    Who is talking with who? (a high level view of NeoQuotes architecture)

    Who is talking with who? (a high level view of NeoQuotes architecture)

    Sinatra eased this part even more, through it’s easiness of building API’s like applications. All vxml interfaces and grammars are bellow /app/views/voice folder, and there are only two voice routes in application.rb.

    To use the Voxeo service, is simple. You only need to create an account, and after that, set up a new application through Voxeo Application Manager, informing the voice entry point of your application (the full URL to your route. In my case to the get ‘/voice/index.vxml’ route).

    Note that your application need to be accessible by Voxeo server. So don’t forget to git push heroku master, before setting up your app on Voxeo.

    Finishing, you’ll get the numbers to your application. I always tested with Skype VoIP number. Works very well here in Brazil and is totally free.

    You can try calling to NeoQuotes! This is the Skype VoIP number: +990009369996189207 (to see all available numbers for NeoQuotes access the application and click on the respective top nav bar link).

    Important: When you spell the stock symbol, say one letter, and wait the voice repeat what you just said. And go on. When you finish, you can say “Okay!”, “Go!” or “Search!” for example. If your desired symbol have an ‘.‘ you have to say “dot”. The voice will not repeat this (will stay in silence). Just continue with the letters or numbers.

    Summing up

    This demo application contains an interesting stack of technologies, providing an environment to develop robust and testable Neo4j applications, with a lot of fun. Certainly much more can be done and improved. And you can help filling issues and submitting pull requests!

    Please, help voting in this application at Gensen repository or help with a Tweet!

    Thank you Neo4j for running this challenge! It was very fun to participate.

     
  • Tomás Augusto Müller 10:09 pm on August 5, 2009 Permalink | Reply
    Tags: ,   

    JavaFX Honorable Mention and new computer! 

    Hello people! How much time, isn’t?

    In my last post I covered my participation at the JavaFX challenge.
    And, finally the JavaFX coding challenge came to end. You can view the final results here.

    Yesterday I received one e-mail from the judging team informing that the jury awarded me one of the Honorable Mention prizes for the application I’ve submitted. That’s nice!!

    I’m happy with the results of this challenge. I can explain why, in three steps:
    - First of all: I took only three days to develop and submit my entire participation (counting with the blog post). And at same time of the contest, the same old (but true) story: my job, and had many exams and assignments at my university. Remembering the contest submissions deadline: from March 23rd to May 29th.
    - Second (and the most dramatic): my computer! With a few time to waste, my last computer, which I consider nowadays as a total garbage, too slow, does not helped me. I say “last” because today my new notebook arrived!
    - The first winner application does not run in my old machine! Without a video card, is to heavy for it to run. Second winner application runs, but veeery slow.
    But, as I said, I’m happy!
    Congratulations to all participants!
    See you in the next contest!

    update: check out my talk about JavaFX in Students Views and Reviews – Sun on Campus blog

     
    • Cris 9:10 am on August 6, 2009 Permalink

      Congratulations, Tunico! An Honorable Mention has more value then the first prize to me! This boy is a genious!!!!!

    • David M Young 3:16 am on August 15, 2009 Permalink

      Congratulations!

  • Tomás Augusto Müller 9:00 pm on November 25, 2008 Permalink | Reply
    Tags: ,   

    Grand Prize Winner – Sun Student Reviews Contest 

    Hohoho! christmasbluetree1 Christmas is comming very early this year!

    Yesterday the final results for the MySQL and GlassFish Sun Student Reviews Contest were published! And guess who is the grand prize winner for the general students category? Yes! It’s me!! This is very cool.
    Thank to all and congratulations to all others entries! Below the winners list:

    Campus Ambassadors Category

    Grand Prize Winner: Kolli Bharath, Dhirubhai Ambani Institute of Information and Communication Technology, India (review, project)

    Second Prize Winners (alphabetically sorted by first name):
    1. Aadhar Mittal, Delhi University, India (
    review, project)
    2. Jose Maria Silveira Neto, Universidade Federal do Ceará, Brazil (review, project)
    3. Qi Cao, Wuhan University, China (review, project)
    4. Vitorio Sassi, UFRGS, Brazil (review, project) (shared with Ronaldo Prass)

    Kolli BharathKolli Bharath

    General Students Category

    Grand Prize Winner: Tomas Augusto Muller, Universidade de Santa Cruz do Sul, Brazil (review, project)

    Second Prize Winners (alphabetically sorted by first name):
    1. Ronaldo Prass, Unisinos, Brazil (
    review, project) (shared with Vitorio Sassi)
    2. Tejesh Morla, University of Illinois at Springfield, USA (review, project)
    3. Varun Bhatia, University of Delhi, India (review, project)

    Tomas MullerTomas Augusto Muller
     
  • Tomás Augusto Müller 8:04 pm on October 21, 2008 Permalink | Reply
    Tags: contest, , glassfish, , , opensource, ,   

    Powering what you don’t see with Glassfish and MySQL 

    Have you ever heard about VoiceXML? It’s a W3C standart that allows you to build web pages that are accessed by voice! It’s very used for services like travel tickets selling, hotel reservation, bank account information and so on. In this post, we’ll give you a general view of how to make a basic hotel reservation
    application with VoiceXML and how to run it using Glassfish and MySQL.

    First of all, for VoiceXML applications, we need a voice gateway. We used the Voxeo, it’s free and provides you with phone numbers that you can call for free using Skype. All you need to do is create a free account in Voxeo and register your application by informing it’s URL. After registering you’ll receive the unique phone number for your application.

    We’ll assume you already know the basics of VoiceXML syntax for the rest of this post. If you are completely new to VoiceXML, we recomend you to visit some of these sites:

    How it Works

    The user may use his phone to call to the voice gateway. The voice gateway will interact as a voice browser, saying the output of the VoiceXML application and waiting for user inputs. It’ll use the internet to access the VoiceXML application, that is deployed in a Glassfish V2 UR2 application server for dynamic content generation. The database used to store user information and hotel reservation is a MySQl 5.1 Community edition.

    The Glassfish server recieves the voice gateway http requests, query the MySQL database and returns a web page with the requested information in VoiceXML syntax. Normally it’ll be a form with some input fields that must be filed by the user. The voice gateway then asks for user input and, once it’s finished, the information is sent back to the Glassfish server as a HTTP GET or POST.

    Other option for the user is to access it right from the web. In our hotel reservation example, we allow only the query for hotel reservations.

    Building the Application

    In the Glassfish side, we used the Java Server Pages technology with the Spring framework and iBATIS as the Data Mapper framework. From Spring, we used SpringMVC for the MVC design pattern, SpringORM for Spring Dao pattern and the dependency injection pattern.

    This allowed us to easily create the application with all the functionality we needed. Note that the MVC pattern was applied in the voice application and the acronym still valid. Instead of View we have Voice. For the database modeling, MySQL Workbench was used, a great free tool for this task.

    The database ended looking up like this:

    another MySQL Workbench screenshot, showing the VoiceHotel Database Model

    Once the database is created, you just need to generate the SQL script from MySQL Workbench and execute it with MySQL. The CLI command to do this is:

    mysql -u user -p < script_file.sql

    where user is the database user and -p will ask you for the password.

    Other options is use your IDE for doing this or MySQL Workbench. The main Java IDEs are NetBeans and Eclipse. Both IDEs allows the connection with MySQL and the automatic deployment in Glassfish. Using Eclipse the deployment can be done coding a deploy task in one Ant build file, or using another mechanism like Maven. This makes the application development even faster.

    With MySQL Workbench we have a set of nice and useful features like Import Reverse Engineer MySQL create script for importing a database from script, allowing us to edit this new database, and save these modifications. The databases can be exported using a feature called Forward Engineer SQL CREATE/ALTER script. Another nice thing is the visual insert editor, making a lot easier pre-populate the database with data.

    Deploying the Application

    With the Java and the VoiceXML code ready, we need to put it online. With Glassfish, all you need to do is either, use your IDE to deploy it with one click, or put the .war file in the autodeploy folder.

    Another possibility is make use of Glassfish Admin Console. With one Glassfish “fresh installation” this can be done accessing http://localhost:4848/. Default administrator user name is ‘admin’ and default password for admin user is ‘adminadmin’.

    After logging in, all you need to do is access Web Applications section, click on deploy button, select your war file and that’s it.

    Conclusion

    VoiceXML applications are a great way to give more than one access possibility to a service and using Glassfish and MySQL for developing this applications is incredibly easy. You barely take notice of them :)

    You can access our voice hotel application by calling +990009369996079911 from Skype and visualize the data by accessing http://inf.unisc.br/tmuller/viewDatabaseTableData.voice.

    The project is located at http://voicehotel.dev.java.net and you can download all it’s source codes. More info is located at https://voicehotel.dev.java.net/source/browse/voicehotel/trunk/artifacts/documentation/.

     
c
compose new post
j
next post/next comment
k
previous post/previous comment
r
reply
e
edit
o
show/hide comments
t
go to top
l
go to login
h
show/hide help
shift + esc
cancel
Follow

Get every new post delivered to your Inbox.