Libwww

libwww

Other names	[CERN] Common [WWW] Library,[1][2] CERN World-Wide Web Library of Common Code,[3] W3C Reference Library,[4] W3C Sample Code Library,[5] W3C Protocol Library[6]
Original author(s)	Tim Berners-Lee,[6] Jean-François Groff,[7][6] Henrik Frystyk Nielsen[6][8]
Developer(s)	José Kahan
Initial release	1.0, November 1992; 32 years ago (1992-11)[9]
Stable release	5.4.2[10]  / 24 June 2017; 7 years ago (24 June 2017)
Repository	github.com/w3c/libwww
Written in	C
Operating system	FreeBSD,[11] Solaris,[11] Linux,[11] Mac OS X,[11] Microsoft Windows[11]
Type	Library for web browsers, servers, and other protocols
License	W3C Software Notice and License
Website	www.w3.org/Library

Libwww is an early World Wide Web software library providing core functions for web browsers, implementing HTML, HTTP, and other technologies. Tim Berners-Lee, at the European Organization for Nuclear Research (CERN), released libwww (then also called the Common Library) in late 1992, comprising reusable code from the first browsers (WorldWideWeb and Line Mode Browser).

Libwww was relied upon by the then popular browser Mosaic.^[12] By 1997, interest in libwww declined, and the World Wide Web Consortium (W3C), which took over from CERN, reduced its commitment to the project.^[13] Later, the purpose of libwww was redefined to be "a testbed for protocol experiments";^[6] in that role it was maintained for the benefit of the W3C's web standards-promoting browser Amaya.^[14] Active development of libwww stopped in 2000.^[9][15]

In 1991 and 1992, Tim Berners-Lee and a student at CERN named Jean-François Groff rewrote various components of the original WorldWideWeb browser for the NeXTstep operating system in portable C code, in order to demonstrate the potential of the World Wide Web.^[16] In the beginning, libwww was referred to as the Common Library and was not available as a separate product.^[1] Before becoming generally available, libwww was integrated in the CERN program library (CERNLIB).^[17] In July 1992 the library was ported to DECnet.^[18] In the May 1993 World Wide Web Newsletter Berners-Lee announced that the Common Library was now called libwww and was licensed as public domain to encourage the development of web browsers.^[19] He initially considered releasing the software under the GNU General Public License, rather than into the public domain, but decided against it due to concerns that large corporations such as IBM would be deterred from using it by the restrictions of the GPL.^[16][20] The rapid early development of the library caused Robert Cailliau problems when integrating it into his MacWWW browser.^[12]

From February 1994 to July 1999 (versions 2.17 to 5.2.8), Henrik Frystyk Nielsen was responsible for libwww, first as a graduate student at CERN and later at the World Wide Web Consortium (W3C).^[6][8][21] On 21 March 1995, with the release of version 3.0, CERN transferred responsibility for libwww to the W3C.^[9] From 1995 onwards, the Line Mode Browser was no longer released separately, but part of the libwww package.^[22]

On 2 March 1997, Nielsen announced that Libwww 5.1 was expected to be the last release.^[13] Later that year, on 24 Dec 1997, Nielsen put out an unsuccessful call for another party outside W3C to take over maintenance of the library.^[23]

Nielsen left the W3C in July 1999, and the project was thereafter headed by José Kahan as the only W3C employee involved with the project.^[21][14]

On 2 September 2003 the W3C (re-)stated that development had stopped, citing a lack of resources.^[24] On 29 January 2004, the W3C once again confirmed that it would not continue development, and was seeking open source community maintainers.^[25]

The first (and only) "community supported maintenance release" was made in 2005, after a gap of 3 years.^[15] After a further lapse of 12 years, a security patch was released in 2017.^[26]

In 2003, Kahan claimed that "libwww is the only library that has a full implementation of the HTTP specification, including caching and pipelining."^[24]

Libwww supports following protocols:

• file^[27]
• FTP^[27]
• Gopher^[27]
• HTTP 1.1 with a Persistent Cache Manager,^[27] pipelining^[9]
• NNTP^[27]
• Telnet^[27]
• WAIS^[27]

Other features include:

• TLS and SSL can be used through OpenSSL.^[28]
• gzip compression and decompression through zlib^[29]
• a HTML,^[30][31] RDF,^[32] SGML^[33] and XML^[32] parser and a style sheet manager^[34]
• an integration of a SQL database (using the MySQL server) for e.g. web crawlers^[35]

Libwww supports plug-ins.^[36]

It has been used for applications of varying sizes, including web browsers, editors, Internet bots, and batch tools. Pluggable modules provided with libwww add support for HTTP/1.1 with caching, pipelining, POST, Digest Authentication, and deflate.

The W3C created the Arena web browser as a testbed and testing tool for HTML3, Cascading Style Sheets (CSS), Portable Network Graphics (PNG) and libwww, among other technologies.^[37] Arena was later replaced in that role by Amaya.^[38]

According to a survey conducted in September 2003, at least 19 applications used libwww.^[25]

• Agora^[39]
• Arena^[40][41]
• Amaya^[40][41][42]
• Cello^[43]
• CERN httpd server^[41]
• Cygwin^[44][45]
• Distributed Oceanographic Data Systems with the OPeNDAP^[46][47]
• GRIF Symposia, a HTML editor^[48][49]
• Lynx^[9][41]
• MacWWW^[50]
• Mosaic^[9][12][41]
• Robot Operating System (ROS)^[51]
• TkWeb^[52]
• tkWWW^[53]
• WorldWideWeb (later Nexus)^[54][55]

Integrated applications in libwww are:

• Command Line Tool, an application which shows how to use libwww to build simple batch mode tools to access the Web.^[36][56]
• Line Mode Browser, a Spartan web browser.^[57]
• Webbot, a simple application showing how to use libwww to build robots.^[36][58]
• Mini Server, a small application showing how to implement a server or a proxy using libwww.^[36]

The developers of libcurl have criticised libwww as being not as portable, not thread-safe and lacking several HTTP authentication types.^[59] Neither libcurl nor libwww are lightweight enough for some projects.^[60]

• Library for WWW in Perl
• cURL

• Official website
• libwww hackers
• The architecture of libwww
  • The historic architecture of libwww presented on the Mosaic and the Web conference in Chicago