Welcome!

Java IoT Authors: Liz McMillan, Roger Strukhoff, Elizabeth White, Scott Allen, Kevin Benedict

Blog Feed Post

MarkLogic 6: An introduction

By

The latest permeation of MarkLogic (version 6) offers ACID (atomicity, consistency, isolation, durability) transactions, horizontal scaling, real-time indexing, high availability, disaster recovery, government-grade security and built-in search.

MarkLogic has made application development easier with Java and REST APIs. They also added JSON support. This allows developers to use their language of choice, and eliminate the need to learn new production language. It also provides data visualization widgets. These widgets can display the shape and dimensions of data, identify trends or patterns and explore the data as a whole.

Version 6 also comes with built in database analytics. Integration with IBM Cognos and Tableau is included as well. This enables analysts to create reports, dashboards and the data. Lastly, version 6 adds the in-database MapReduce capabilities.

Find out more about MarkLogic version 6 here.

And here is more from their website:

Mission-critical Big Data Applications around the world are powered by MarkLogic. It is the only Enterprise NoSQL database that manages all types of data at scale in real time. It gives you the range of features you need to deliver value. It lets you leverage your existing tools, knowledge, and experience. And it provides a reliable, scalable, and secure platform for your important data.

New Feature Highlights

Business Intelligence Tools

Business Intelligence Tools
Big Data in the enterprise needs to be accessible to everyone who could benefit from the information. To make that easier, MarkLogic now includes out-of-the-box integration with Business Intelligence tools like IBM Cognos and Tableau to allow analysts to use familiar solutions for generating reports, dashboards and data exploration results from data stored in MarkLogic.

 

REST API

REST API
In order to enable developers to work in their language of choice, MarkLogic now includes a REST API that allows you to perform searches, create documents, read documents, update documents, and delete documents. The REST API allows you to build fully functional MarkLogic applications in any programming language. It also allows you to directly load JSON documents.

 

MarkLogic Java API

MarkLogic Java API
The new Java API allows you full-featured access to MarkLogic functionality with pure Java. The MarkLogic Java API is written on top of the REST API, and has all of its functionality such as paginated search with facets and snippets, full document CRUD operations, and more.

 

Enhanced JSON Support

Enhanced JSON Support
Our new JSON library makes it easy to store JSON documents as key-value stores, and to convert them back and forth between JSON and XML. The REST Client API and the MarkLogic Client API for Java make use of this functionality to make it easier to load and work with JSON documents.

 

Visualization Widgets

Visualization Widgets
We’ve also added Visualization Widgets so you can easily build powerful applications that help your users discover the shape and dimensions of data, quickly assess trends and patterns, and explore data more intuitively. You can access these widgets with MarkLogic Application Builder.

 

In-database MapReduce & User Defined Functions

In-database MapReduce & User Defined Functions
Many customers wanted more flexibility to develop complex, real-time analytics. We’ve extended MarkLogic 6 to let you create user-defined aggregate functions (UDFs) that take advantage of MarkLogic’s parallel-processing architecture. We call this In-database MapReduce, and it lets you create blindingly fast analytic functions with custom C++ code by writing “map” and “reduce” functions.

 

In-Database Analytic Functions

In-Database Analytic Functions
In order to enable customers to leverage the power of the MarkLogic platform to produce enterprise-grade analytics, we’ve included several built-in XQuery functions to perform analytic and statistical functions.

 

MarkLogic Content Pump (mlcp)

MarkLogic Content Pump
In order to speed loading and exporting of data between databases, we are introducing the MarkLogic Content Pump (mlcp). mlcp is a command-line tool for loading content into MarkLogic Server and for migrating content from one instance of MarkLogic to another, even if they are on different platforms. If you have a Hadoop cluster, mlcp takes advantage of Hadoop to parallelize the loading. mlcp takes much of the functionality of the open source projects Record Loader and xqsync and bundles them in a single package, and allows them to take advantage of Hadoop if it is available; Hadoop is not required to use mlcp, but is used if it is available.

 

FIPS 140-2 Cryptographic Compliance

FIPS 140-2 Cryptographic Compliance
MarkLogic 6 includes the OpenSSL Federal Information Processing Standard (FIPS) Object Module, which was evaluated by the National Institute of Standards (NIST) for FIPS 140-2 compliance. More details on the OpenSSL Object Module and on the FIPS 140-2 compliance.

 

Search API Enhancements

Search API Enhancements
When you’ve got a lot of data, great search is key. We’ve worked to make our search API even better with the following enhancements:

  • Structured Search
  • Extracting metadata at search time
  • Modify the unconstrained term behavior using <search:term>
  • Range constraints for path range indexes
  • Ability to return values from range indexes with search:values
  • JSON key support

 

Path Range Indexes

Path Range Indexes
In order to enable fine-grained range indexes while maintaining the advantages of using the lexicon functions and the range query constructors MarkLogic now includes support for range index specified by a path. You can specify a subset of XPath as the definition of what goes into an index. The search API can take advantage of path range indexes to create range constraints on them. Path range indexes are also useful when setting up SQL views on data stored in a MarkLogic database.

 

Synonym Search

Synonym Search
You now have the option to ensure that documents that contain multiple synonyms are scored appropriately, rather than unnaturally gaining points to the search score. Learn more about how the architecture of MarkLogic works and how you can deploy it.

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@ThingsExpo Stories
In his session at @ThingsExpo, Kausik Sridharabalan, founder and CTO of Pulzze Systems, Inc., will focus on key challenges in building an Internet of Things solution infrastructure. He will shed light on efficient ways of defining interactions within IoT solutions, leading to cost and time reduction. He will also introduce ways to handle data and how one can develop IoT solutions that are lean, flexible and configurable, thus making IoT infrastructure agile and scalable.
SYS-CON Events announced today that Numerex Corp, a leading provider of managed enterprise solutions enabling the Internet of Things (IoT), will exhibit at the 19th International Cloud Expo | @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Numerex Corp. (NASDAQ:NMRX) is a leading provider of managed enterprise solutions enabling the Internet of Things (IoT). The Company's solutions produce new revenue streams or create operating...
In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
Fifty billion connected devices and still no winning protocols standards. HTTP, WebSockets, MQTT, and CoAP seem to be leading in the IoT protocol race at the moment but many more protocols are getting introduced on a regular basis. Each protocol has its pros and cons depending on the nature of the communications. Does there really need to be only one protocol to rule them all? Of course not. In his session at @ThingsExpo, Chris Matthieu, co-founder and CTO of Octoblu, walk you through how Oct...
IoT is fundamentally transforming the auto industry, turning the vehicle into a hub for connected services, including safety, infotainment and usage-based insurance. Auto manufacturers – and businesses across all verticals – have built an entire ecosystem around the Connected Car, creating new customer touch points and revenue streams. In his session at @ThingsExpo, Macario Namie, Head of IoT Strategy at Cisco Jasper, will share real-world examples of how IoT transforms the car from a static p...
Web Real-Time Communication APIs have quickly revolutionized what browsers are capable of. In addition to video and audio streams, we can now bi-directionally send arbitrary data over WebRTC's PeerConnection Data Channels. With the advent of Progressive Web Apps and new hardware APIs such as WebBluetooh and WebUSB, we can finally enable users to stitch together the Internet of Things directly from their browsers while communicating privately and securely in a decentralized way.
"My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, will discuss the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports. The session will include a working demo and a technical d...
Why do your mobile transformations need to happen today? Mobile is the strategy that enterprise transformation centers on to drive customer engagement. In his general session at @ThingsExpo, Roger Woods, Director, Mobile Product & Strategy – Adobe Marketing Cloud, covered key IoT and mobile trends that are forcing mobile transformation, key components of a solid mobile strategy and explored how brands are effectively driving mobile change throughout the enterprise.
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the back-end service, and the mobile application for the end user’s controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target –...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
Personalization has long been the holy grail of marketing. Simply stated, communicate the most relevant offer to the right person and you will increase sales. To achieve this, you must understand the individual. Consequently, digital marketers developed many ways to gather and leverage customer information to deliver targeted experiences. In his session at @ThingsExpo, Lou Casal, Founder and Principal Consultant at Practicala, discussed how the Internet of Things (IoT) has accelerated our abil...
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
Digital innovation is the next big wave of business transformation based on digital technologies of which IoT and Big Data are key components, For example: Business boundary innovation is a challenge to excavate third-party business value using IoT and BigData, like Nest Business structure innovation may propose re-building business structure from scratch, as Uber does in the taxicab industry The social model innovation is also a big challenge to the new social architecture with the design fr...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, provided tips on how to be successful in large scale machine learning...
If you had a chance to enter on the ground level of the largest e-commerce market in the world – would you? China is the world’s most populated country with the second largest economy and the world’s fastest growing market. It is estimated that by 2018 the Chinese market will be reaching over $30 billion in gaming revenue alone. Admittedly for a foreign company, doing business in China can be challenging. Often changing laws, administrative regulations and the often inscrutable Chinese Interne...
Data is an unusual currency; it is not restricted by the same transactional limitations as money or people. In fact, the more that you leverage your data across multiple business use cases, the more valuable it becomes to the organization. And the same can be said about the organization’s analytics. In his session at 19th Cloud Expo, Bill Schmarzo, CTO for the Big Data Practice at EMC, will introduce a methodology for capturing, enriching and sharing data (and analytics) across the organizati...
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2016 Silicon Valley. The 6thInternet of @ThingsExpo will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.