Open Source Myths: open Source Search Needs More Assistance
That was, in essence, a question posed by Daniel Tunkelang on his blog in his commentary on the launch of Lucid Imagination
. Its a fair one to ask and an issue that has been raised before.
First, some distinctions. Lucene is a Java search library with best practice indexing and query capabilities that have been continuously improved over the past 10 years. Its cleanly implemented and not very hard to embed in an application, as thousands of Lucene-based application developers have discovered. But its only a library, so there is a certain amount of infrastructure that you have to build around it if you want to create an application, especially if you want something thats flexible and easily maintained.
Enter Solr, released by Apache in January, 2007. Solr is a scalable search platform. It puts Lucene over http and adds infrastructure such as schema-based management of fields (including how theyre defined and processed), an admin interface, cache management, tools for replication and data loading, logging and statistics and more. It also adds faceting, which is not an infrastructure improvement but an additional user-visible feature for doing the kind of categorizing of results that has become very popular at places like Amazon.
With Solr you no longer need to write a Java program. One of the popular talks at ApacheCon is Solr out-of-the-box all the things you can do with Solr without writing code. People can try this out by downloading the Solr tutorial included with the Lucid Solr download or by downloading it from Apache. Does Solr have all the packaging and features found in the best commercial search engines? Not today. But neither does every user need all (or even most) of them. Whats more important for most developers is how easy it is to turn a search platform commercial or open source into an application, and how easy or hard it is to maintain it. Lucene/Solr is well written software with a modular architecture, and its easy to plug in or unplug various available modules or, if needed, to write new ones. Disk overhead, relevancy ranking, throughput and query speed are all on par with, and often superior to, the best commercial engines. That translates to less needed customization and ongoing attention to a Lucene/Solr application.
There are also the obvious advantages to open source: complete access to the code to figure out whats going or make a change that you want, when you want it; an active community that responds to questions or problems; and no license costs.
Do open source projects often require consultants?
In my experience, no more than commercial applications, some of which pretty much require the vendors professional services group to make a complex product usable, or to make needed, even trivial modifications, over and above the license cost of the product. Consultants may stand out more in some open source situations but thats because theyre often independent consultants, rather than the paid services a commercial company provides with its product.
Might you be inclined to hire consultants for open source applications?
I think yesbut thats because you have the freedom to hire them to get the application to do just what you want, and getting search to be really good is still an art. Much of the work weve done at Lucid has been to extend it for customers who wanted an extension when they needed it, or to assist them with planning their search application.
Sois there any down-side to open source Lucene/Solr?
Yesbut its not really about complexity or customization. What you dont have with Lucene/Solr is a comprehensive support contract Apache doesnt provide them. Its solid enough (and has source available) that this hasnt stopped organizations of all sizes from moving to Lucene/Solr, but community and self-support are not for everyone. What you also dont have with Lucene/Solr is a single assured place to turn to when you do need expert assistance, or want training. Those are gaps Lucid Imagination hopes to fill by providing high quality responsive support and services from a staff with over 70 years of cumulative experience building search applications.
One Response to Open Source myths:
Open Source search needs more assistance
1.Thanks for a realistic, practical, honest, fair comprehensive assessment of the total picture.
For just a lib, & not needing Java code development for use, scalability, and features, Solr is outstanding. It has earned its stripes.
As a Senior Program Manager, I found that for Health Care and Utility companies, one needed the concept of:
Contingency,Support, training, and code optimization, test, & unique feature enhances plans/resources for just-in-case need.In some cases this reserved financial budget, that might not even be used, might be less than 1/3 to 1/4 cost of accuiring Brand Name Commercial Products.
In case of Solr, being a Basic Search lib with strong community and spread of apps, this is an easy sales pitch for C-level executives to buy in.
by: Lucid Imagination
Colocation Myths Unraveled Top 5 Myths About the FAFSA Myths related to the slot machines…!! The Myths & Facts About ADHD Drunk Driving - 3 Myths About Alcohol and Impaired Driving The 5 Myths of Air Duct Cleaning Three Botox Myths Debunked Debunking the Myths and Revealing the TRUTH on How to Create Toned and Defined Abs! What is Epigenetics Theory? Myths and Facts Myths About Entrepreneurship What is JWH018? Myths and Facts The Five Myths About Doing a Good Abs Workout 3 Myths About Presenting To Seniors