A portable approach to Federated Search using Solr Drupal Node Js trio for better scalability

Abhijeet Sinha
Vidhatanand V

According to IDC, 90% of all the digital information is unstructured locked in multiple repositories and digital businesses have either underinvested in technology or invested in substandard technology in order to access them. Traditional search method leads to failures majorly due to the absence of optimisation practices and lack of unified framework. In a data-driven world, unlocking the hidden insights, that are shut off from view within both structured and unstructured data present in multiple repositories, is more critical than ever.

Today, the sheer quantity and the pace of digital information that knowledge workers have to deal with every day are dramatically increasing. To tame the chaos of multiple repositories is a challenge. There has to be a deployment of a search method over distributed and even heterogeneous data sets in order to receive a unified results list. This brings us to Federated Search.

OpenSense Labs initiated one such enterprise search tinkering robust Apache Solr and versatile Drupal 8 for eleven different websites with a great variation in CMS leveraging portability using Node JS.

In this session, we will equip you with the know-how of:

Enhancing website search experience retaining a blend of useful and accurate results
Expanding inter-site searchability decreasing the bounce rate and latency
Increasing data discovery and interoperability of information by cross-functional support to a plethora of platforms

The major takeaways would be:

Challenges amidst architecting a microservice
Scraping content using an open-source tool like Scrappy
PHP is slow, how do you make Drupal faster?
Fiddling the Solr configuration and boosting queries
Using Node JS to serve content on the go

https://2019.badcamp.org/session/portable-approach-federated-search-using-solr-drupal-node-js-trio-better-scalability