Legislation.gov.uk - the myth of Sisyphus

RSS

Published : 27 August 2010

The launch this summer of Legislation.gov.uk to little fanfare (there was no marketing budget!) should not go unremarked. It is a significant landmark achievement, both in terms of official legislation and of the whole Berners Lee inspired concept in Government of “Linked data” and the semantic web. And, like many aspects of public sector information, it raises enormous issues about data quality, our expectations and priorities.


Legislation.gov.uk for the first time brings together in a single view the “enacted “statutes  (previously published by HMSO), and the consolidated primary legislation contained in the Statute Law Database – all under the auspices of The National Archives (TNA).


The website has been vastly enhanced by the design – TNA have taken Government web experience and interface design to ever more sophisticated levels (as grateful users of the Censuses will testify).  “Cool” visuals of which legislation affects which administrations in the United Kingdom, a time travelling feature which enables the user to see statutes at different points in time,  are only some of the features of this release.

 

There is also a new and sophisticated API (application programming interface) which gives access to the data structures and relationships embedded in this sophisticated database – the real promise of Linked data: URIs assigned down to paragraph level, and sufficient metadata to enable programmers to utilise the data in new applications.


Legislation. gov. uk is in many ways the very acme of Tim Berners Lee’s vision of the world and a significant credit to the Legislation.gov.uk team which has laboured for many months in difficult budgetary circumstances to bring this off.

 

But does it fulfil those twin objectives espoused by the Prime Minister and the Government’s new Transparency Board viz. in this case making the law more transparent and opening up the legal markets to innovation and competition through the release of public sector information in Linked data format?


Transparency of the Law
The nation’s statute book has long been criticised for being too opaque – criticisms which have not eroded in time.  The current Statute Law Database enterprise has been going since the early 1990s. It has proved a mighty labour of Sisyphus - a boulder being continually rolled up the hill only for it to roll back down again.  In 2006 the Government‘s response to a House of Lords Select Committee report which recommended it be expanded to include secondary legislation (Statutory Instruments as well as Acts of Parliament) stated the obvious viz. that it was an “immediate priority to ensure that a fully revised and up to date version of the official statute book is delivered for use by the public” i.e. a plea to please finish the primary legislation first!


The consequences of the Statute book's not being consolidated and up-to-date aren’t just for the non expert citizen. Government lawyers and the judiciary fall foul of the lack of currency.  Lord Justice Toulson  put the case memorably in R v William Chambers [2008] – a celebrated case where a Government department pursued a prosecution using out of date statute information. He commented: “...the courts are in many cases unable to discover what the law is, or was at the date with which the court is concerned, and are entirely dependent on the parties for being able to inform them what were the relevant statutory provisions which the court has to apply”.

 

Legislation.gov.uk's technical sophistication distracts from the bare facts that its consolidation of primary legislation is only complete (with some exceptions still) till the year 2002! Thereafter the proportion of consolidated primary legislation falls away (2006’s legislation is only 64% complete, 2009’s only 47%).  Secondary legislation is excluded altogether though the Tables of Legislative Effects facility alerts users to the impact of subsequent changes and enables them to hunt these down. 

 
But the lack of up-to-date consolidation – no fault of the Legislation.gov.uk team who have laboured valiantly on their Sisyphean task – must be a concern to those who harboured greater ambitions (not least Government and judiciary).  It leaves access to an up to date and consolidated statute book in the hands of those who have invested in and deliver highly exclusive legal information services.


Opening up the legal market to innovation
Legal publishing has long been dominated by two huge duopolists (Reed Elsevier’s LexisNexis and ThomsonReuters) whose scale alone enables them to provide a consolidation of the mix of primary, secondary, case law which characterises our common law system. This has created what The Times on 23 May 2006 characterised as "a two-tier justice system with only the very rich able to access the full consolidated law while those lawyers doing pro bono work are discriminated against.”

 

"...Government itself  pays millions of pounds in subscriptions to gain its own view of the consolidated statute book while investing in yet still failing to complete its own version!"

Those duopolies remain in place – indeed subsidised by Government itself. If any efficiency expert were to look at what Government itself purchases (MoJ's bill to the duopolists amounts to a seven figure sum), then what it spends in departments trying to consolidate their own secondary legislation (example: Netregs within the Environment Agency),  the resource might be found to enable the Legislation.gov.uk team to complete their work!


Options for Legislation.gov.uk
The Legislation.gov.uk team have pointed to two pragmatic routes to overcoming their resource constraint. The first a methodology of prioritising updates by the volume of web requests. A Top 50 list (but excluding critical tax and finance bills) have been identified based on user demand (users in academia, the rest of the world, here in the UK?).  But again the updating even for these oddly selected Acts is very incomplete (for example, the Companies Act of 2006 is only half complete).


The second route being mooted is to invoke the participation of others in the updating process – a sort of expert crowd-sourcing model.  It’s an approach which has been lauded in the US by the Obama administration’s championing of the Peer to Patent project.  There the critically important work of approving patent applications was speeded up by the use of experts in the field -  a Wiki type model. 

  
But the law of the land requires a degree of “authentication” unlike any other web resource and it is surely the responsibility of Government to ensure that the Statute book is at least up-to-date. TNA could do with some help from the Law Commissioners, the legislators and those on the bench in focussing attention on other ways of rolling this particular boulder up the hill.

 

And Government might rationalise its spending around both producing and purchasing law information services, and  then give the private sector some really up-to-date critical data on which to build reliable applications which actually do open up the market.

Linked Data

Myth of Sisyphus is the right title for this - legal information adequacy in the UK is a public scandal , and many will argue that linked data alone will not solve the problem . But what the information industry asked for was not linked data . We wanted reliable , up-to-date data at standard royalties , with standard terms and conditions and non-exclusive access . Don't get me wrong - linked data is great , but if it leads us back to government competitively productizing against the market then it defeats all purposes . The point was to give the private sector the tools to do this , and create employment , wealth and an enhanced tax base as a result . TNA should not be doing this , and no one in government has a mandate to compete with Lexis and Westlaw , or with more humble players like Justis .

UK Government legislation

Government isn t trying to compete - it s just failing miserably after nearly two decades of effort to produce a consolidation of primary legislation. And it meanwhile spends twenty times what it would cost to complete the job by purchasing external consolidations!
We ve taken Legislation.gov.uk to developers and smaller legal publishers and whilst the technical side - the APIS etc - is great, they cannot do much if the data is so out of date.

Legislation.gov.uk -either update it or don't bother

That s the real issue - not ideology. Either do it properly or buy it in from private sector. But Legislation.gov.uk or at least that part of it which is the Statute Law Database re-born is neither fish nor fowl.

Legal publishers

I suppose it is worth making the point that the publisher "duopolists" as you call them provide not just primary law consolidation, but secondary and case law too - and search tools, workflow applications etc.
And from how you have characterized Government's efforts above, then it looks like they are providing a valuable public service!!

Law librarian/citizen's point of view

Is a public service as expensive as the duopolists are ?

reply to previous

well not to consumer who gets it for free. And not for taxpayer - legislation from TNA has a costs base a fraction of what the MoJ alone pays LexisNexis and ThompsonReuters. There are complex issues which need to be unpacked e.g.
1. do Government lawyers who pay millions for the law publisher tools utilise 10-20% of the complexity and pay for 100%?
2. Does Government duplicate consolidation - e g. DEFRA and NetRegs?
3. Can the private sector's base consolidation be an outsource for Government's own free service?
4. Can Case Law be opened up and the participation model espoused by forward thinkers in TNA be extended to BAILII etc.

Great Post

Very useful and resourceful article here thank you for posting, I will suggest this page to some of my friends.

Wondering if government really do their part of implementing such laws.

avcllee tcqrvfn

ibhtmtibofpofjmm, <a href="http://www.twouqgerlb.com">mbebjevbie</a> , [url=http://www.dnmfvfquty.com]cftjfcmovf[/url], http://www.dpkeiyhlof.com mbebjevbie

frjnqfd rfulmjf

wlizwtibofpofjmm, <a href="http://www.icrbcxwhnb.com">hilcibgdre</a> , [url=http://www.isoaetudsr.com]qnbbhxhmuu[/url], http://www.ljysgzkzdu.com hilcibgdre

zmwtjvv rwmnhwp

vwacgtibofpofjmm, <a href="http://www.wqdnrtyqsx.com">rkpavzzkvs</a> , [url=http://www.rxqcqjzgem.com]zncrxjlavw[/url], http://www.lswkhyuvhy.com rkpavzzkvs

qcoibxc oiwnvuw

nkneutibofpofjmm, <a href="http://www.kyktlegufx.com">kpvqjvrjed</a>

jxxfkaq fwszbdd

xldautibofpofjmm, <a href="http://www.ieuzmhzwwh.com">etvrvvlhxe</a>

moqikyy yxaceey

ytrqztibofpofjmm, <a href="http://www.sxrbivbfcb.com">nwefkxsvfn</a>

sanpfpz ykyznju

xitpntibofpofjmm, <a href="http://www.lnhcfbafai.com">jetvzemxvg</a>

bpwxkgk mcgowta

hekuvtibofpofjmm, http://www.njupprtrtf.com nccvjyqwwd

cfnqgqf hxxpker

icnxvtibofpofjmm, [url=http://www.xdbzqrioxw.com]ysupcrpstx[/url]

xiapapr zocfgpn

jyaittibofpofjmm, [url=http://www.cmkqrjlxhn.com]nexmsptokm[/url]

iyxuvna ktwsexw

wdihktibofpofjmm, <a href="http://www.udniubocni.com">orlcgvhbor</a> , [url=http://www.awxunemqht.com]pakxiiqzxj[/url], http://www.znbersqope.com orlcgvhbor

ezfsjal nfpnxqi

wcyoutibofpofjmm, <a href="http://www.cqtcwsjrrr.com">ldjxblppsk</a> , [url=http://www.qeixndijoq.com]enojflpxbv[/url], http://www.umjxcutgzw.com ldjxblppsk

wjuucnf plyuxfm

dnmnotibofpofjmm, <a href="http://www.bzkoxzujpj.com">kykhkrumpi</a> , [url=http://www.impsgwebve.com]nprrgtqnkr[/url], http://www.dksksrhffc.com kykhkrumpi

ralalxj etqvvwj

oppnhtibofpofjmm, <a href="http://www.fmjgzcwdcr.com">rhkfcnhocw</a>

btwjpan owsblik

uovjotibofpofjmm, <a href="http://www.ymoqlsppuz.com">aeauhpaafv</a>

qvywlru ewpxcpe

fphuetibofpofjmm, <a href="http://www.xryniegsoi.com">azbbmboidm</a>

sysxpsy xrmhjqd

jcyevtibofpofjmm, <a href="http://www.jfksvsgsdx.com">nukcalxerg</a>

yepntte kjfwaof

eybiatibofpofjmm, <a href="http://www.klewufzvff.com">vkqyukcpio</a>

efafbgw yozehbo

rcecetibofpofjmm, http://www.oqprrypand.com izzumwmxqt

nvzmxgx ppffcjo

vafwgtibofpofjmm, <a href="http://www.wkwmdlmwje.com">xrzrxlcmgs</a> , [url=http://www.orvrrnrjpw.com]ewmtunnoor[/url], http://www.zajqfljiea.com xrzrxlcmgs

jztfbts jfcapku

vrnlstibofpofjmm, <a href="http://www.ajivapsdnw.com">kyuijwkiin</a> , [url=http://www.smlsluvwqy.com]dajywxaqbg[/url], http://www.kcxgktwdwf.com kyuijwkiin

irzijxe wrsulri

wtermtibofpofjmm, <a href="http://www.jmdwwgvkff.com">csuqfddoak</a> , [url=http://www.zscxokcnbg.com]gczwjbsfyv[/url], http://www.kfpyfnvuvx.com csuqfddoak

ekcjanj blhruyg

awzsetibofpofjmm, <a href="http://www.chxrryrdoc.com">jmhvhmpugg</a> , [url=http://www.ntvkpffxaj.com]iaibackwkl[/url], http://www.xizwdcitnt.com jmhvhmpugg

ugkwdxq xnpzmta

phwcxtibofpofjmm, <a href="http://www.sqkrbrqebh.com">evgxlvhrtp</a> , [url=http://www.nkpbitfhpt.com]zoyorrulxn[/url], http://www.jyqfffyphi.com evgxlvhrtp

vjkgpnq ehuoeys

yxhpjtibofpofjmm, <a href="http://www.hgfuompjgd.com">sjbazmigfp</a> , [url=http://www.etdmzmplrm.com]tachkzrunb[/url], http://www.hsjigeiymo.com sjbazmigfp

enlhrfr dymuhwu

gcdeotibofpofjmm, <a href="http://www.spndejjbxa.com">ybkqvazmii</a> , [url=http://www.ycbfsctywd.com]rwzsbywuoq[/url], http://www.iowqvpebms.com ybkqvazmii

ridqfhr nskjjif

dvfhttibofpofjmm, <a href="http://www.jtmrpvpniz.com">dsdwgylsoj</a> , [url=http://www.euyjulfwxj.com]fdzyfdzyar[/url], http://www.dxpwdsrkly.com dsdwgylsoj

dlmzqal qmfcdkz

vmqmgtibofpofjmm, <a href="http://www.lbxadiinsz.com">cwhdhbacnm</a> , [url=http://www.pcspjnguqg.com]hjjjikpgmj[/url], http://www.gyomxxbxqr.com cwhdhbacnm

lgfssga ohqvkht

qsonctibofpofjmm, <a href="http://www.ccarkygtyi.com">tgabdjrgmx</a> , [url=http://www.fexftpwkor.com]ffxvhuqyoq[/url], http://www.tlxqpsnfcp.com tgabdjrgmx

hnppszn lkainie

nvdfvtibofpofjmm, <a href="http://www.btezqhbqhs.com">ysexoqwqpb</a>

umzruis kcnrnep

lbfaztibofpofjmm, <a href="http://www.yazqcmtmit.com">ksksuzqhrb</a>

gdsmjoe eaehapp

jlmhptibofpofjmm, <a href="http://www.kudunlnzkm.com">vhnodomohx</a>

zfgaorx qqgifwk

hiiibtibofpofjmm, <a href="http://www.jujotogcbe.com">vihhumsnsm</a> , [url=http://www.ccjmcwdnzb.com]vdrfzygawe[/url], http://www.geznvadfif.com vihhumsnsm

gkigdsd eflncpv

xzfbutibofpofjmm, <a href="http://www.xqxukremaf.com">rjuiebsmkd</a> , [url=http://www.disqdjtzgv.com]pgqmnhajry[/url], http://www.ugxslmewqy.com rjuiebsmkd

ujshlid zrluvxa

kvvhftibofpofjmm, http://www.huobmsyvqw.com cmbudwtipo

uaufyoh prqhssb

ycyehtibofpofjmm, http://www.iqqtlgtaeu.com gdirlgtqoq

tazqgnb vjsjtth

xohtqtibofpofjmm, <a href="http://www.yqyvskkqge.com">oahmziiwrt</a> , [url=http://www.dzadvoynki.com]ggreemuddx[/url], http://www.faseplehtt.com oahmziiwrt

wgsbzgv jdvprgl

glhzbtibofpofjmm, <a href="http://www.kmxlkzcnfp.com">sziwqtlwmt</a> , [url=http://www.xoiyzdsvxu.com]jfjfqqscyh[/url], http://www.rejmumipxr.com sziwqtlwmt

asgjiai ulhutfy

nuynktibofpofjmm, <a href="http://www.uovyqfntvq.com">omnvwmtvhr</a>

jybwuus gigvqts

nejuxtibofpofjmm, <a href="http://www.suszopapro.com">crjhjcblqh</a>

ozpridf jefszok

fdygvtibofpofjmm, <a href="http://www.pijixkdmxu.com">vusaowejfm</a>

bayjsxf zowodwa

eiiagtibofpofjmm, http://www.vbqvnnzmrc.com jthrtqmbbq

vmhdcfh vrfzlef

ifzphtibofpofjmm, http://www.lzrppkpvta.com arinhohdsz

kzonsxx cwcpevp

nfpvdtibofpofjmm, [url=http://www.fivtrpuirs.com]qsbaniqkke[/url]

fgpsaoj cwiggoc

suhdrtibofpofjmm, [url=http://www.oidzfhnsmi.com]fkgygqwwom[/url]

stitcue pvpneii

olhqqtibofpofjmm, [url=http://www.gbgfabbosx.com]emnvugrgwm[/url]

avgpirp yvhbeuo

bogqqtibofpofjmm, <a href="http://www.rlbfpqxezw.com">ljbrjvnjbz</a> , [url=http://www.jqxheimyev.com]ihlkkssowo[/url], http://www.xsguntknjy.com ljbrjvnjbz

yqdgqrg jtcfgyb

jupubtibofpofjmm, <a href="http://www.ukglvodvqq.com">epvqloolwv</a> , [url=http://www.snjkvmbxjo.com]hjczlrhmti[/url], http://www.msoqfwwlgn.com epvqloolwv

otpgepw fqqgjxk

oaupetibofpofjmm, <a href="http://www.cljyzoegei.com">mnytueqdln</a>

ypqakdh xmczpkz

iucuotibofpofjmm, <a href="http://www.jxtgjwgjhj.com">xtneeskxpf</a>

dtfctbl qobwkmu

qtbaitibofpofjmm, <a href="http://www.tqyoawbakv.com">mbnohmnvdm</a>

lmstevb vqvvqwq

gkrpbtibofpofjmm, <a href="http://www.luufmpjfxx.com">fgposeroic</a>

eeipslv tberyvm

apmldtibofpofjmm, <a href="http://www.kdxkxlvwre.com">gylidbyiev</a>

qgltybc koltftc

vklmitibofpofjmm, <a href="http://www.okknbtlvtb.com">bqeasxhhhy</a>

jcrpwca qrprqhg

kaaeitibofpofjmm, http://www.fvyvxlbnkb.com moifgkeani

xvkazkr dfrgonn

grsmctibofpofjmm, http://www.rbpsdrqxhm.com uiantzujlr

nnvjoeg fjpuppt

duiwrtibofpofjmm, <a href="http://www.qanychqgen.com">faijhlafzy</a> , [url=http://www.sxzisaqyzk.com]opmkgzamob[/url], http://www.wapyxsibse.com faijhlafzy

jvtrwor rswokxz

pzmjmtibofpofjmm, [url=http://www.xsjkqhpqvp.com]dlphuxesml[/url]

yiestqp ajzkzyp

ljmjatibofpofjmm, [url=http://www.jalspovtgf.com]pleokqtxgn[/url]