Big Memory Go.

Big Memory Go.

Big Data is a Hot topic during these days. As Industry is moving towards the Big Data concept implementations and it adopted the Big data architecture by lots of leading software products.

I would call this as a next frontier for the innovation, competition towards the productivity.

The amount of data handling or processing in our world has been exploding, analysing of large data sets, This will become the key basis of future data handling.

Big Data comes handy when it integrate with the Big Memory concept as well. Performance of the system is the key factor for any system and customer expecting a high performance system with high availability. Usually Java applications run with in the specified JVM memory configurations, What if we system wants to use the Server memory or ram directly?  Why keep unused memory in system resources ? Can you access system memory to save and retrieve objects effectively and store frequently used objects on ram instead of keeping those in JVM level data structures.

Yes, you can with Java's new direct memory accessing features. But why do we re-invent the wheel. I found a good library called BigMemory Go maintained by Terracotta. 

Best feature I saw in this implementation is, it has free license version where users can extend their Big memory data collection upto 32GB amount the RAMs. and direct integration with EhCache data cacheing.

This Big memory implementation allow us to specify the no of elements need to be keep on EhCache and overflowing elements to be store on system memory. As I benchmark these implementation with SQL, Its obvious using this mechanism systems can reach high performance levels.

Real-time Big Data made simple, made better

BigMemory Go lets you keep all of your application's data instantly available in your server's memory. If you're still using only a few gigs of RAM for fear of garbage collection performance hits, then it’s time to add the power of BigMemory Go in-memory data management to your apps. You get in-memory speed, enterprise-grade reliabilty, automatic disk backup, and fast restartability, with no tuning or proprietary hardware—all with 32GB free.
Get 32GB free of BigMemory Go »

 BigMemory Go, you get:
      Unlimited in-memory data management on one Java Virtual Machine (JVM), 32GB free,
      Advanced monitoring, search, and management for in-memory data

Terracotta get started : http://terracotta.org/documentation/bigmemorygo/get-started

------------------------------------------------------------------------------------------------------------------------------------------

Big Memory Setup:

Step 01: Download following dependencies

• bigmemory-3.7.2.jar – This is the main JAR to enable BigMemory.
• ehcache-ee-2.6.3.jar – This file contains the API to BigMemory Go.
• slf4j-api-1.6.1.jar  – logging framework.
• slf4j-jdk14-1.6.1.jar

Step 02:

Save the BigMemory Go license-key file to the BigMemory Go home directory. This file, called terracotta-license.key, was attached to an email you received after registering for the BigMemory Go download.

Alternatively, you can add the license-key file to your application's classpath, or specify it with the following Java system property:

-Dcom.tc.productkey.path=/path/to/terracotta-license.key

Step 03:  Add the following configurations to your existing EhCache Cache implementation.

Configuration managerConfiguration = new Configuration()
        .name("bigmemory-config")
        .cache(new CacheConfiguration()
            .name("bm") //  cache name
            .maxBytesLocalHeap(128, MemoryUnit.MEGABYTES) // ehCache Memory
            .maxBytesLocalOffHeap(1, MemoryUnit.GIGABYTES) // Big Memory allocation from system ram, 1 GB
            .copyOnRead(true)
            .statistics(true)
            .eternal(true)
        );  //restartable
 
    CacheManager manager = CacheManager.create(managerConfiguration);
    try {
      Cache bm = manager.getCache("bm"); // calling the cache
      //bm is now ready.
 
      System.out.println("**** Successfully created - Programmatic based **** ");