Google Index Database to be Archived?
498819
Google Index Database to be Archived?  TechDirt reports that the San Jose Mercury News is running an article about Brewster Kahle's Internet Archive - Archive.org. While he's been profiled many times before, the one interesting tidbit to slip out this time is that Kahle has asked Google to donate their database ...
200433
An enhanced multi-threaded syslogd, supporting reliable syslog over TCP and RFC 3195, writing to MySQL databases, fully configurable output formats (with great timestamps), ability to filter on anything, and on-the-wire message compression.   Hi all,  Rsyslog 3.11.2 has just been released. Now it has the ability to convert text files into syslog. This is done by the imfile plugin, which monitors text files. A new libdbi-based output plugin has been written. This adds six additional databases (including Firebird and Oracle) to the supported database set. Also contains small bug fixes. Version 3.11.2 is a recommended release for all version 3 users.  Doc for new Modules:    http://www.rsyslog.com/doc-omlibdbi.html    http://www.rsyslog.com/doc-imfile.html  Changelog:    http://www.rsyslog.com/Article175.phtml  Download:    http://www.rsyslog.com/Downloads-req-getit-lid-79.phtml  I hope this release is useful. As always, feedback is appreciated.  Best regards, Rainer Gerhards
422149
We turned off share.opml.org yesterday, for good, as far as I know. It was a good idea, but we never got it together to make it the powerhouse I wanted it to be.  Now that Google and Bloglines both have discovery mechanisms for feeds that you might like, based on what you and others like, there would only be a future for SYO if it were a thriving and growing community, and it isn't.  Normally, I'd leave a site like that running indefinitely, but this one needed its own server, and I wanted to cut my server expenses now that my S3 bill is going up, serving some very big JPEGs and generally being the back-end for a community that is growing, the people using FlickrFan. If there's a big demand to bring it back, we can -- but that's going to require cash flow to go with it. At this point, I don't think it's a good investment for me. Still diggin!
657090
Google's Desktop Search application indexes a PC hard drive when it's not being used
606469
Kasper Johansen has posted to the PHP-GTK Community website some information about a new application that can help manage databases like phpMyAdmin does (and uses a PHP framework to do it - knj SQL-admin.   This application can manage a database for you, in the way phpMyAdmin does. Furthermore, it can convert various types of databases to another type of database (ig from MySQL to SQLite, Access to MySQL, PostgreSQL to MySQL and more).   You can get more information about the project and framework from its site over on SourceForge.
363687
User-Guided Search Refining in Google  Despite the fact that the Google API hasn't been updated in over two years, people keep doing Cool Things with it. The latest Cool Thing I've seen is the very nice MyGoogleSearch ( http://www.mygooglesearch.com ). The idea behind this hack is that you can take the ...
159285
Brian Deshong has this new post on his blog today with an alternative method for doing the old standby "who's online" for your website.   Whenever you Google around for things like "Who's Online php", you'll find that a lot of the solutions are centered around using a database. However, is this really necessary? [...] One goal here: get Who's Online functionality off of the database. We'll explore a possible solution with Memcached that I've personally implemented, and thus far, it's been working great.   His alternative, using the memcache functionality that can be enabled in PHP, stores a "user ID" (either a real user ID or just some unique identifier) and their last activity time. This information is stored in a local file that can be queued each time the page it loaded. The other piece is a backend script that goes through this same file and clears out the old values. Depending on the size of the file/traffic of the site, this process could even be integrated into the same script that writes it.
235197
In what could be a historic move in the history of the internet, Google has announced arrangements with Harvard University, and a handful of public libraries, to digitize parts of their valuable collections and make them available over the public web.
227940
Google&#39;s project to archive millions of books from top libraries, experts said, is the first major step toward the company&#39;s goal of indexing massive amounts of printed material, music and video.
261406
NASA is joining forces with the Internet Archive to digitize its vast collection of space photos, film, video and images. The effort is expected to take five years.
284350
Directive does not apply to search engines Google is not bound by the Data Retention Directive when it comes to search engine logs, Europe's data protection committee has said. Google has used the Directive to justify keeping data, but OUT-LAW has learned that the law does not apply.â¦
124501
What is Google IndexBench? Someone at Google is up to something that has to do with indexes or benches, or both, and has been purchasing several domains related to the term &#8220;index bench.&#8221; Gary Price of ResourceShelf and Ask.com pointed out on Friday that Google has registered the following domain names: bench-index.com (and .org, .info), benchindex.com (and [...]
121284
Librarians&#8217; Internet Index Adds New Search Technology One of the most trusted and quality oriented directories on the Internet, the Librarians&#8217; Internet Index (or LII.org) has recently undergone some changes to its search and navigational features. Gary Price has the scoop on ResourceShelf  :  The new Librarians&#8217; Internet Index database is online today powered by [...]
347484
Sam  posts an interesting proposal.  This is better than the HTTP delta suggestion but still has a few issues.  The client needs to know the ETags before it can start performing differential fetches.  With date ranges you still preserve the initial archive query.  For example when you first subscribe to a feed you could fetch 30 days worth of posts.  If you like the feed you can even fetch *older* posts which could be really cool.  Also even if you still use faster checksum algorithm like CRC32 or Adler32 you still have an O(N) performance hit for your document.  If you have a btree on your post dates you will gave O(log(N)) for search for a much smaller string (64bit in most situations).  F ...
475094
The data-storage problem isn't simple, but Firefox developers are looking to bridge the gap for such Web apps as Gmail and Hotmail -- just one aspect of the rethinking going into the 3.0 version of the browser, due later this year. One question: Are you ready for some SQL?
429406
One of the major issues plaguing search engines right now is the growing list of web documents available online. While no exact numbers are available, there are billions of search results to sort through. But, they can&#8217;t all be relevant both on material content and time &#8212; can they?  Of course they&#8217;re not, and Google [...]
123912
This  is very interesting:  "As large MediaWiki deployments may gain performance using Memcached, at some level cost of RAM to store all objects becomes too high. In order to balance resource usage and take more use of Apache server disks, Tugela, the distributed cached on-disk hash database, has arrived."  So Tugela  is like memcached but backed by a disk-based btree.  Since most memcached installs are usually backed by MySQL we would just be duplicating some of the work that MySQL already does. Of course this is probably being a bit unfair.  There wouldn't be any locking in this situation.  I'd like to see benchmarks though.  I'm pretty sure it wouldn't be able to beat an InnoDB install.   ...