<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	
	xmlns:georss="http://www.georss.org/georss"
	xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#"
	>

<channel>
	<title>data</title>
	<atom:link href="https://dgen.net/0/category/data/feed/" rel="self" type="application/rss+xml" />
	<link>https://dgen.net/0</link>
	<description>Designing our data infrastructure</description>
	<lastBuildDate>Fri, 15 May 2026 09:36:26 +0000</lastBuildDate>
	<language>en-GB</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.0</generator>

<image>
	<url>https://dgen.net/0/wp-content/uploads/2017/02/cropped-dgen-D-logo-2017-32x32.png</url>
	<title>data</title>
	<link>https://dgen.net/0</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">232530259</site>	<item>
		<title>Introducing cl8; connecting constellations</title>
		<link>https://dgen.net/0/2026/05/12/constellation/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Tue, 12 May 2026 08:08:33 +0000</pubDate>
				<category><![CDATA[Culture]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[projects]]></category>
		<category><![CDATA[socialchange]]></category>
		<category><![CDATA[web]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=8215</guid>

					<description><![CDATA[<img width="1024" height="576" src="https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1024x576.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" fetchpriority="high" srcset="https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1024x576.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1536x864.jpg 1536w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" />Hi friends, what have you all been learning? Many years ago (as captured in my 2017 Thread), I was trying to work out not just [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="1024" height="576" src="https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1024x576.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1024x576.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-1536x864.jpg 1536w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/05/cl8-blog-2026-05-10.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" />
<h2 class="wp-block-heading">Hi friends, what have you all been learning?</h2>



<p class="wp-block-paragraph">Many years ago (as captured in my <a href="/0/thread/thread-2/#constellation">2017 Thread</a>), I was trying to work out not just what everyone in my fascinating networks of friends, peers and collaborators were <em>doing</em>, but what knowledge they&#8217;d gathered.</p>



<p class="wp-block-paragraph">When you know people over years and decades, it&#8217;s easy to lose track of what everyone has learned, what they are interested in, and what unexpected collaborations might exist as a result.</p>



<p class="wp-block-paragraph">I&#8217;m often approached as someone who &#8216;<em>probably knows someone who does that</em>&#8216; and wanted to work out how to do that better, and to get out of the way far faster.</p>



<p class="wp-block-paragraph">I wondered how to better <em>encourage serendipity</em>: part of this was to hold <a href="https://en.wikipedia.org/wiki/Salon_(gathering)">salon-like</a> evenings on M/S Hans to bring dozens of people together in-person and see what just happened. The energy from those events got me thinking about tools that could support everyone in those quite random settings, without creating yet another social network or yet another thing that got in the way more than it helped.</p>



<p class="has-text-align-center wp-block-paragraph"><a href="https://d.cl8.io">Sign up now</a></p>



<p class="wp-block-paragraph">If you&#8217;re reading this, it&#8217;s likely you already know me, so please feel free to sign up here (and note that the approval process is manual, so it won&#8217;t be instant).</p>



<h2 class="wp-block-heading">Let&#8217;s connect on our skills and interests and have fun</h2>



<p class="wp-block-paragraph">The same challenge applies to most networking events, socials, and conferences—there&#8217;s a plethora of &#8216;conference apps&#8217; that are every bit as awful as you&#8217;d imagine (Whova, Hopin, Brella et al). But how to connect communities who have ideas, collaboration and work to do together? You might remember someone who you met at an event, half-remember their organisation, might want make an introduction and you can&#8217;t quite pull the thread, and everyone&#8217;s overwhelmed with social media connections.</p>



<p class="wp-block-paragraph">For example, in work settings, the usual solution is LinkedIn. However, the usual problem with LinkedIn is that it&#8217;s LinkedIn: optimised for broadcasting and monetisation not belonging, and <a href="https://thenextweb.com/news/linkedin-browsergate-extension-scanning-privacy-fingerprint">your data is theirs</a> the moment you post it. Most people I know who use LinkedIn to connect after a business event just use its messaging function to get to an email address and then stop using it for that. So, there&#8217;s a signal! </p>



<h2 class="wp-block-heading">To start, how about we do less? (but with more fun)</h2>



<p class="wp-block-paragraph"><strong>cl8</strong> is a really small thing: a directory. </p>



<p class="wp-block-paragraph">I grew up in a village of about 700 people &#8211; after a while you&#8217;d kind of just know everyone&#8217;s phone number, and have a sense of what they did. And, if you rewind a few decades, the person who would <strong><em>definitely</em></strong> know that was&#8230;the local telephone operator. One of the last telephone operators was a family friend (thank you Margie Knox), and she knew everyone, everything (and more) about everyone, including how they all connected with each other.  </p>



<p class="wp-block-paragraph">So, can we reboot this in the 2026? </p>



<h2 class="wp-block-heading">Why not just use something that already exists?</h2>



<p class="wp-block-paragraph">Nothing I&#8217;ve found so far quite fills this gap in this way. </p>



<p class="wp-block-paragraph">I&#8217;m sure many have tried and failed (and we may too, but have more fun trying). One pattern I&#8217;m sure of though: small things can survive if they stay the right shape.</p>



<p class="wp-block-paragraph">Looking at alternatives, they tend to fall into three categories: SaaS products that will likely eventually enshittify (Orbit, Luma, and Common Room already did); self-hosted tools that require a lot more faff than the challenge warrants (it needs to be as <em>easy</em> as possible); or shared documents (e.g. Airtable) that go stale because that&#8217;s just what happens: the utility or enthusiasm atrophies and, let&#8217;s face it, they&#8217;re just so <em>desperately</em> dull. </p>



<p class="wp-block-paragraph">None of them seem to hold the shape of a human network, run by individuals, with communities of overlapping and transitory interests, where skills might cluster and gaps are plentiful. And, of course, all of them involve handing your member data to a platform with rights that seek to keep them, rather than keeping users in control.</p>



<p class="wp-block-paragraph">I wanted something lightweight enough to actually run myself, curated enough to stay useful, and honest about what it is: more of a <strong>social directory</strong> rather than a social network. Yes, also looking back to where a lot of social networks began (looking at you, <a href="https://www.well.com">Well</a>), and re-asking if the incentives to &#8216;keep growing&#8217; were the wrong solutions, and for the wrong reasons (looking at you, FB, Tw*t, Ning, and the rest of you). </p>



<h2 class="wp-block-heading">On words</h2>



<p class="wp-block-paragraph"><strong>cl8</strong> is a compression of &#8220;constellation&#8221; or &#8220;constellate&#8221; (as a verb), the name I use for communities of practice, and the (astronomical) language that threads through a lot of my projects.</p>



<p class="wp-block-paragraph">A constellation isn&#8217;t a random scatter of points, it&#8217;s more like a pattern that becomes legible when you can work out how to read it. The points were always there: a constellation is what happens when you impose meaning on proximity and <strong>cl8</strong> is, perhaps, a type of social telescope. The people were already in the room, more or less: the tool just makes connections visible. Less stuff, more fun.</p>



<h2 class="wp-block-heading">What it does</h2>



<p class="wp-block-paragraph">You sign in with Google or a verified email, fill in your name, a short bio, and <strong>tag yourself with your skills and interests</strong>. Ideally not job titles, but rather the things you&#8217;d say to someone when meeting them at one of my salon evenings on the boat.</p>



<p class="wp-block-paragraph">It&#8217;s a searchable, private directory where your profile is visible only to other authenticated members of that <strong>cl8</strong> instance. Access is granted by whoever runs that community: human curation is part of the design.</p>



<p class="wp-block-paragraph">It can run on your own server, your community controls the membership, and your data is yours. I&#8217;ve built it for my dgen network constellation (you can sign up at <a href="https://d.cl8.io/">d.cl8.io</a> and as its curator it may take me a little while to manually approve you). The first instance is also running for IB1 (Icebreaker One), which is exactly the point: one tool, many communities, each owning their own. You can sign up for that one at <a href="https://ib1.org/constellation">ib1.org/constellation</a>. </p>



<p class="wp-block-paragraph">And yes, you&#8217;ll hopefully find some things in all of this that surprise and delight: it&#8217;s the start of a journey to doing things differently. It should be fun, so adding in things for <em><strong>your</strong></em> specific, quirky, bonkers community is up to you. Less faff, more fun.</p>



<h2 class="wp-block-heading">What it doesn&#8217;t do</h2>



<p class="wp-block-paragraph">It doesn&#8217;t </p>



<ul class="wp-block-list">
<li>reveal any information about you to anyone that you don&#8217;t want to share (see <a href="https://d.cl8.io/privacy">https://d.cl8.io/privacy</a>)</li>



<li>track you (no cookies)</li>



<li>create more noise in the world</li>
</ul>



<h2 class="wp-block-heading">On building it</h2>



<p class="wp-block-paragraph"><strong>cl8</strong> is a just few hundred KB of code: a single Node.js file with zero npm dependencies. It mirrors the same architecture as Broadside: copy the file to a server, configure, start a service, done. The data lives in flat JSON. The whole thing was built with AI assistance in the same spirit as the other tools in this stack: it&#8217;s been something I&#8217;ve wanted for years, and AI has helped me build it in about the same time as it would have taken to evaluate and customise any SaaS alternatives and then <em>sign up for none of them</em>.</p>



<p class="wp-block-paragraph">It&#8217;s meant to be the absolute minimum. A social directory for a few hundred people doesn&#8217;t need a database cluster, it does need good session management, solid authentication and security, and enough care in the UI to make filling in your profile feel like something other than homework. Less code, more fun.</p>



<p class="wp-block-paragraph">If you run a community of practice and you&#8217;re tired of it living inside someone else&#8217;s product, ping me. It&#8217;s <a href="https://dgen.net/0/connect/">open licence</a>, deployable in under an hour, and then the only person looking after your community&#8217;s data is you (and them).</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">8215</post-id>	</item>
		<item>
		<title>Broadside: write once, post many, keep everything</title>
		<link>https://dgen.net/0/2026/04/26/broadside/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Sun, 26 Apr 2026 13:00:00 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[Culture]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[media]]></category>
		<category><![CDATA[projects]]></category>
		<category><![CDATA[stuff]]></category>
		<category><![CDATA[web]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7838</guid>

					<description><![CDATA[<img width="1024" height="576" src="https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1024x576.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1024x576.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1536x864.jpg 1536w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" />A self-hosted social posting tool, ensuring you own your own content In my ongoing experiments with ai-assisted dev of tools I&#8217;d like, I&#8217;ve create Broadside [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="1024" height="576" src="https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1024x576.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1024x576.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-1536x864.jpg 1536w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-diamond.v20260427.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" />
<h2 class="wp-block-heading">A self-hosted social posting tool, ensuring you own your own content</h2>



<p class="wp-block-paragraph">In my ongoing experiments with ai-assisted dev of tools I&#8217;d like, I&#8217;ve create Broadside to solve a specific irritation. As we all know, “<a href="https://www.google.com/search?q=%E2%80%9CIf+you+aren%E2%80%99t+paying+for+the+product%2C+you+are+the+product.%E2%80%9D">If you aren’t paying for the product, you are the product</a>.” and as all these tools develop their own special <a href="https://en.wikipedia.org/wiki/Enshittification">enshittifications</a>, it feels like it&#8217;s time to have another go at inverting the models. </p>


<div class="wp-block-image img-left">
<figure class="alignleft size-large is-resized"><a href="https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09.png"><img decoding="async" width="1024" height="685" src="https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09-1024x685.png" alt="" class="wp-image-7862" style="aspect-ratio:1.4949112952561037;object-fit:contain;width:386px;height:auto" srcset="https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09-1024x685.png 1024w, https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09-300x201.png 300w, https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09-768x514.png 768w, https://dgen.net/0/wp-content/uploads/2026/04/Screenshot-2026-04-07-at-19.53.09-1536x1028.png 1536w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>
</div>


<p class="wp-block-paragraph">Also, with the demise of that old-bird-site, things have become more federated and fragmented. I wanted to post across Mastodon, Bluesky, Threads and LinkedIn at the same time, and do so without &#8216;losing&#8217; what I&#8217;d written the moment I hit publish.</p>



<p class="wp-block-paragraph">Broadside it a small web app that posts to all four simultaneously, keeps a searchable archive of everything locally, and pulls social feeds into one place, including creating useful open things, like an RSS feed.  This post is about why I made it, what it does, and the slightly eccentric vocabulary it uses.</p>



<p class="wp-block-paragraph">You can read all my posts here: <a href="https://broadside.dgen.net/bindery/gavin">https://broadside.dgen.net/bindery/gavin</a></p>



<p class="wp-block-paragraph">If you&#8217;d like to try it, just ping me (on any channel).</p>



<h3 class="wp-block-heading"><strong>You probably didn&#8217;t know LinkedIn is a one-way street</strong></h3>



<p class="wp-block-paragraph">If you post to LinkedIn regularly, you&#8217;re building a professional record in a place <strong>you cannot back up</strong>. They do not let you download your own posts in bulk &#8211; the &#8220;account data export&#8221; doesn&#8217;t include posts. You can use their API to POST to the site, but not GET your own content back (without paying).</p>



<p class="wp-block-paragraph">For the platform most associated with <em>professional credibility</em> where people are documenting their work, sharing hard-won thinking, and announcing things that matter to them,  to offer no way to retrieve what you&#8217;ve put there is, to be generous, unprofessional.</p>



<p class="wp-block-paragraph">The same applies across many platforms, to varying degrees and I&#8217;ve maintained this website (dgen.net) to be both a business site and a master record of my own works, that I completely control. With music I am addressing a version of this <a href="https://dgen.net/0/2026/02/25/discovery-collection-connection/">by building a tool to convert my Spotify playlists into a physical record catalogue</a>, because streaming solved discovery but not &#8216;ownership&#8217;. Social media has the same shape: it solved distribution but not possession.  Broadside is an attempt to do something about that. </p>



<p class="wp-block-paragraph">And, yes, of course there are loads of self-publishing tools, but they&#8217;re often commercialised into their own SaaS businesses with similar issues of enshittification (looking at you TweetDeck/HootSuite), or too &#8216;techy&#8217; to actually do yourself. Alternative services, like Mastodon are great but also directly compete with, rather than replace the production flow.</p>



<h2 class="wp-block-heading">What Broadside does</h2>



<p class="wp-block-paragraph">Broadside runs on my own server (you can host your own too, once I get it on GitHub, open licence of course), and it supports multiple users (so I can enable my constellations and communities to use it for free). It connects social accounts, enables a post to be written in a single compose window, and it posts simultaneously to whichever platforms you select (Mastodon, Bluesky, Threads, LinkedIn, or any combination. Note that Facebook and others don&#8217;t allow connections like this). Link previews, image attachments and scheduled posts all work.</p>



<p class="wp-block-paragraph">It also is keep a copy.</p>



<p class="wp-block-paragraph">Before anything goes to a social platform, it&#8217;s written to an archive on my server. That archive is searchable and downloadable. If any other platform disappears, your posts don&#8217;t (nb: if my/your server vanishes, you have backups everywhere else you&#8217;ve posted). If you want to find what you said about something three years ago, you can. This useful to me &#8211; having a personal, searchable archive of all my public writing is just <em>nice</em>, independently of the cross-posting convenience.</p>



<p class="wp-block-paragraph">There&#8217;s also a feed view, pulling in my Mastodon and Bluesky feeds together into one place (NB: LinkedIn and Threads don&#8217;t allow this, and Facebook doesn&#8217;t allow anything). </p>



<h2 class="wp-block-heading">With added AI?</h2>


<div class="wp-block-image img-right">
<figure class="alignright size-large is-resized"><a href="https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04.jpg"><img decoding="async" width="1024" height="555" src="https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-1024x555.jpg" alt="" class="wp-image-7852" style="aspect-ratio:1.8450767065929918;width:472px;height:auto" srcset="https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-1024x555.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-300x163.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-768x416.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-1536x832.jpg 1536w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-830x450.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-230x125.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-350x190.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04-480x260.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/04/Bindery-research-2026-04-04.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>
</div>


<p class="wp-block-paragraph">I added an AI-assisted <strong>research tool</strong> that automatically surfaces related links (e.g. Wikipedia, academic papers, Guardian articles, Hacker News discussions and things I&#8217;m experimenting with) for anything I post. This last bit genuinely surprised me with how useful it can be by lowering the &#8216;friction&#8217; in then googling for references &#8211; in an age of fake news, it&#8217;s nice to filter on some diverse-yet-trusted sources. The whole thing was built with Claude and, like my other experiments is stuff I wanted but would never have had time to build a decade ago.</p>



<h2 class="wp-block-heading">And, a white-listed constellation?</h2>



<p class="wp-block-paragraph">Of course, once you&#8217;ve got a publishing tool that works well, you can share it with your friends. And then you have something that&#8217;s bot-free, curated (h/t <a href="https://www.gyford.com/phil/writing/2007/02/04/the-haddock-dire/">haddock</a>), and more akin to the original idea of shared bookmarking and socials. Back to basics, without the tracking (no, really tracking, like <a href="https://thenextweb.com/news/linkedin-browsergate-extension-scanning-privacy-fingerprint">LinkedIn scanning all your browser extensions to fingerprint your machine and track you</a> is actually a thing, never mind cookies).</p>



<p class="wp-block-paragraph">All while <strong>not having to switch</strong> away from, or shut down, places you like to hangout with <em><strong>other</strong> </em>friends and colleagues.</p>



<p class="wp-block-paragraph">You can probably guess where I might go next with this: not leaving places, but rather <em><strong>connecting</strong></em> them.</p>



<h2 class="wp-block-heading">On words</h2>



<p class="wp-block-paragraph">Those who know me already know I love finding fun words (e.g. <a href="http://ib1.org">Icebreaker One</a>, <a href="https://dgen.net/0/2017/03/10/the-amee-story-part-one/">AMEE</a>, <a href="https://dgen.net/0/overview/tornado-history/">Tornado</a>) to make using things <em>just feel good</em>.  And, of course, design matters deeply to all of this so I&#8217;m experimenting with letting people choose their own themes.  We love to personalise things. </p>



<p class="wp-block-paragraph">Note that while I&#8217;m using ai for these prototypes, a quick plug for my friends at <a href="https://philpottdesign.com/">philpottdesign.com</a>, just because ;).</p>



<p class="wp-block-paragraph">I&#8217;ve given Broadside its own vocabulary because I think it&#8217;s  more interesting than calling things &#8220;dashboard&#8221; and &#8220;feed&#8221;.</p>



<p class="wp-block-paragraph"><strong>Broadside</strong>: historically, this is a large sheet printed on one side and distributed as news, proclamations, or verse &#8211; one of the original one-to-many formats. It felt right for a tool that takes one piece of writing and to many public spaces at once. Obviously, given my interest in things nautical, broadside is also when all the guns on one side of a warship are fired simultaneously&#8230; so quite apt!</p>



<p class="wp-block-paragraph"><strong>The Murmurator</strong>: the compose interface. A murmuration is what you see when a flock of starlings moves as one coherent shape. Social media can feel a bit like that and The Murmurator is where you introduce something into the flow.</p>



<p class="wp-block-paragraph"><strong>Murmurings</strong>: your own incoming feeds from the people you follow, across the networks.</p>



<p class="wp-block-paragraph"><strong>The Bindery</strong>: your personal post archive. The Bindery refers to &#8220;a&nbsp;studio,&nbsp;workshop&nbsp;or&nbsp;factory&nbsp;where sheets of (usually) paper are fastened together to make books&#8221; [<a href="https://en.wikipedia.org/wiki/Bindery">wikipedia</a>] so felt apt for where your own posts are gathered, ordered, and made publicly accessible by default (as a public web page and RSS feed).</p>



<p class="wp-block-paragraph"><strong>Commonplace</strong>: As I add people from my constellation into our shared Broadside instance, the Commonplace is our collective archive: everything everyone has posted, in one place (as a public web page and RSS feed). (originally I used <em>Sammelband</em> a <a href="https://en.wikipedia.org/wiki/Sammelband">German word</a> for a &#8216;volume that binds together separately published works&#8217; but that was getting a bit too esoteric, even for me).</p>



<h2 class="wp-block-heading"><strong>Addenda</strong>: re-establishing control</h2>



<p class="wp-block-paragraph">Stepping aside from all the stupid AI-hype, I think we&#8217;re at a fascinating juncture that reminds me of the 1990s early web. The same AI tools that vast platform players are racing to deploy to bind us <strong>to them</strong>, are equally available to <strong>all of us</strong>. </p>



<p class="wp-block-paragraph">We can all now build personalised infrastructure, in hours or days, that would have taken dedicated teams many months or years before. Broadside is an example of this: a small act of reclaiming your relationship with your own writing, from the platforms you publish on and can control.</p>



<p class="wp-block-paragraph">If we can&#8217;t build things for everyone, it won&#8217;t <em>work</em> for all of us.</p>



<p class="wp-block-paragraph">To quote NTK, &#8220;<em>THEY STOLE OUR REVOLUTION</em>. NOW WE&#8217;RE STEALING IT BACK&#8221;</p>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk.jpg"><img decoding="async" width="1024" height="576" src="https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-1024x576.jpg" alt="" class="wp-image-8209" srcset="https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-1024x576.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/04/broadside-ntk.jpg 1200w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7838</post-id>	</item>
		<item>
		<title>AI-enabled Hi-Fi adventures</title>
		<link>https://dgen.net/0/2026/02/20/ai-enabled-hifi-adventures/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Fri, 20 Feb 2026 16:14:51 +0000</pubDate>
				<category><![CDATA[data]]></category>
		<category><![CDATA[media]]></category>
		<category><![CDATA[music]]></category>
		<category><![CDATA[stuff]]></category>
		<category><![CDATA[web]]></category>
		<category><![CDATA[ai]]></category>
		<category><![CDATA[api]]></category>
		<category><![CDATA[hi-fi]]></category>
		<category><![CDATA[pi]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7740</guid>

					<description><![CDATA[<img width="1024" height="683" src="https://dgen.net/0/wp-content/uploads/2026/02/amp-1024x683.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2026/02/amp-1024x683.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/02/amp-300x200.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/02/amp-768x512.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/amp-830x553.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/amp-230x153.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/amp-350x233.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/amp-480x320.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/amp.jpg 1200w" sizes="(max-width: 1024px) 100vw, 1024px" />AI-generated image of an amplifier being controlled via a web interface.]]></description>
										<content:encoded><![CDATA[<img width="1024" height="683" src="https://dgen.net/0/wp-content/uploads/2026/02/amp-1024x683.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2026/02/amp-1024x683.jpg 1024w, https://dgen.net/0/wp-content/uploads/2026/02/amp-300x200.jpg 300w, https://dgen.net/0/wp-content/uploads/2026/02/amp-768x512.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/amp-830x553.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/amp-230x153.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/amp-350x233.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/amp-480x320.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/amp.jpg 1200w" sizes="(max-width: 1024px) 100vw, 1024px" />
<p class="wp-block-paragraph">I wonder if AI might actually help us actually break away from native mobile apps for a lot of things &amp; &#8216;get back to the web&#8217;? </p>



<p class="wp-block-paragraph">Many modern hi-fi amplifiers have &#8216;an App&#8217;. They are, uniformly (from what I can see), terrible.</p>



<p class="wp-block-paragraph">In this post I show how I &#8216;fixed this&#8217; in <strong>under an hour</strong> using ai to do something I would never, ever have got around to doing. Given how much I listen to music, I know it&#8217;s going to save me many hours of irritation. It even left me with enough time to write this post.</p>



<p class="wp-block-paragraph">Let&#8217;s start with the challenge.  In the UK we spend about £600M a year on hi-fi stuff: that seems like quite a lot. And the higher-end kit costs more than your PC. However, while they &#8216;try and be digital&#8217;, it&#8217;s like walking back into the 1990s as a user. </p>



<p class="wp-block-paragraph">Here are some screenshots from the &#8216;flagship&#8217; Marantz app starting up.</p>



<figure class="wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex">
<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1.jpg"><img decoding="async" width="461" height="1024" data-id="7743" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-461x1024.jpg" alt="" class="wp-image-7743" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132503_marantz-avr-remote_55106088266_o-1.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o.jpg"><img decoding="async" width="461" height="1024" data-id="7744" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-461x1024.jpg" alt="" class="wp-image-7744" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132526_marantz-avr-remote_55106289933_o.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o.jpg"><img decoding="async" width="461" height="1024" data-id="7746" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-461x1024.jpg" alt="" class="wp-image-7746" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132603_marantz-avr-remote_55106465980_o.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>
</figure>



<p class="wp-block-paragraph">I should point out that not only is the user interface <strong>terrible</strong> (including trying to get you to sign up to their <a href="https://www.reddit.com/r/heos/comments/ibp45y/heos_software_is_complete_garbage_almost_to_the/">HEOS garbage</a>) but it takes needless <strong>ages </strong>to start up and navigate. Those spinning disks spin for a long time, and then present with a page with a <strong><em>tiny </em></strong>round button for the volume and mostly meaningless other stuff that&#8217;s too small to consistently accurately tap. It&#8217;s really easy to accidentally turn the volume up a lot (which on a >3kW system can be alarming if you&#8217;re not expecting it).</p>



<p class="wp-block-paragraph">Let&#8217;s say you want to turn the volume down (the #1 thing you do on an amp &#8216;instantly&#8217;), it can take up to <strong>10 seconds</strong> to get there. This means you revert back to the remote control, or &#8211; heaven forbid &#8211; <em>have to actually stand up and turn actual the volume control &#8211; there are plenty of other apps that tell us when we need to move <img src="https://s.w.org/images/core/emoji/17.0.2/72x72/1f609.png" alt="😉" class="wp-smiley" style="height: 1em; max-height: 1em;" /></em>. Further, to get into any granular controls such as changing sound processing, or changing the volume on individual surround channels is painfully slow (tens of seconds to get to, seconds for each change), cumbersome and, actually just <strong>unusable</strong>. I often want to do this for specific tracks when in a proper listening session.</p>



<figure class="wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-2 is-layout-flex wp-block-gallery-is-layout-flex">
<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o.jpg"><img decoding="async" width="461" height="1024" data-id="7747" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-461x1024.jpg" alt="" class="wp-image-7747" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132612_marantz-avr-remote_55105203647_o.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o.jpg"><img decoding="async" width="461" height="1024" data-id="7748" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-461x1024.jpg" alt="" class="wp-image-7748" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132628_marantz-avr-remote_55106466135_o.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o.jpg"><img decoding="async" width="461" height="1024" data-id="7750" src="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-461x1024.jpg" alt="" class="wp-image-7750" srcset="https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-461x1024.jpg 461w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-135x300.jpg 135w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-768x1707.jpg 768w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-691x1536.jpg 691w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-922x2048.jpg 922w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-830x1844.jpg 830w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-230x511.jpg 230w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-350x778.jpg 350w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o-480x1067.jpg 480w, https://dgen.net/0/wp-content/uploads/2026/02/screenshot_20260220_132652_marantz-avr-remote_55106290143_o.jpg 1080w" sizes="(max-width: 461px) 100vw, 461px" /></a></figure>
</figure>



<p class="wp-block-paragraph">Clearly in 2026 this really isn&#8217;t good enough.   Fortunately this is now something (almost) anyone can fix without waiting for manufacturers to wake up and do something. </p>



<p class="wp-block-paragraph">Googling around the docs there are some API standards and I&#8217;d done some previous command-line work to pull status and push things like volume to see if it all actually worked (it did). </p>



<p class="wp-block-paragraph">But now, with the wonders of AI (in this case, <em><a href="https://claude.ai">Claude.ai</a></em>) it is almost <em>magically trivial to make your own interface.</em></p>



<p class="wp-block-paragraph">In this post I show how easy (and things that can be frustrating).</p>



<p class="wp-block-paragraph">Let&#8217;s start with a bit of magic: I asked Claude (thinking that this wouldn&#8217;t be enough)</p>



<pre class="wp-block-code"><code>&gt; develop a web interface for the Marantz SR7015 using its API</code></pre>



<p class="wp-block-paragraph">It wasn&#8217;t just &#8220;enough&#8221;, it even styled the page with custom fonts and an image of a surround setup. To get it actually working (locally, on my Mac) I just had to give it the error I got</p>



<pre class="wp-block-code"><code>&gt; it says "Cannot reach 192.168.1.46"</code></pre>



<p class="wp-block-paragraph">At which point the AI created a local proxy server, told me how to install it and some supporting packages (with copy/paste instructions). If I rewind to when I used to be able to actually code, I think this would have all easily taken me a day. Instead it took this aging hacker about 30 mins of faffing around. This was it &#8211; a fully working, way better visual interface and way better user experience (it loads <strong>instantly</strong> with no noticeable latency on the controls), and individual controls, all on one screen. And, against a black background as usually listening when it&#8217;s dark (or watching a movie).</p>


<div class="wp-block-image">
<figure class="aligncenter size-full is-resized"><a href="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-scaled.png"><img decoding="async" width="1260" height="2560" src="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-scaled.png" alt="" class="wp-image-7753" style="aspect-ratio:0.49219353841397434;width:558px;height:auto" srcset="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-scaled.png 1260w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-148x300.png 148w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-504x1024.png 504w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-768x1561.png 768w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-756x1536.png 756w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-1008x2048.png 1008w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-830x1687.png 830w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-230x467.png 230w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-350x711.png 350w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-12.29.22-480x976.png 480w" sizes="(max-width: 1260px) 100vw, 1260px" /></a></figure>
</div>


<p class="wp-block-paragraph">I then spent a few hours playing around with layouts to see what was possible, then asked the AI to make a version I would run on my Pi-Fi (the <a href="https://dgen.net/0/2023/07/05/bringing-album-art-back-to-life/">Raspberry Pi I have that displays album art</a> when Spotify is playing). Which, of course, it did at a similar pace. </p>



<p class="wp-block-paragraph">This means I can access a web page on my home&#8217;s wifi network on my phone, laptop or desktop &#8211; as can anyone I give the web address to who is with me. I can use it as a remote for the amplifier, not just for volume, but including controlling all the parameters I actually want to access instantly, with nice big buttons and only the things I need.  It still wasn&#8217;t able to do some things (like more nuanced reading/writing of custom fields).</p>



<p class="wp-block-paragraph">I then added <strong>new functionality</strong> &#8211; to pair and group left and right speakers into &#8216;front&#8217;, &#8216;surround&#8217; so I can control the top-front-side-back distribution more easily (unless you&#8217;re a sound engineer, you&#8217;ll be surprise how much more this varies than you&#8217;d think based on the mix and type of the music). </p>



<p class="wp-block-paragraph">And, finally, for now, a joystick control to move the balance around between all 11 speakers. Which was done with a single prompt:</p>



<pre class="wp-block-code"><code>> create a joystick control to balance the audio between all the speakers</code></pre>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07.png"><img decoding="async" width="1024" height="689" src="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-1024x689.png" alt="" class="wp-image-7799" srcset="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-1024x689.png 1024w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-300x202.png 300w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-768x517.png 768w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-1536x1034.png 1536w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-830x559.png 830w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-230x155.png 230w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-350x236.png 350w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07-480x323.png 480w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-17.55.07.png 1744w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>



<iframe loading="lazy" width="315" height="560" src="https://www.youtube.com/embed/PUtGOzQ18Ug?si=7Gn8waH_MPbBeIto" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>



<p class="wp-block-paragraph">Next up I&#8217;m thinking of keying together listening room profiles per track, keyed into what&#8217;s playing on Spotify so the entire balance of the system can auto-configure based on what&#8217;s playing. This would then include <a href="https://dgen.net/0/2022/12/22/a-stereo-or-a-soundstage/">custom listening profiles and sound stages</a> I&#8217;d set up for specific favourite tracks. It&#8217;s almost as if one could take all this too far*&#8230;? </p>



<figure class="wp-block-image size-full is-resized"><a href="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-scaled.png"><img decoding="async" width="1910" height="2560" src="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-scaled.png" alt="" class="wp-image-7763" style="width:828px;height:auto" srcset="https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-scaled.png 1910w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-224x300.png 224w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-764x1024.png 764w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-768x1029.png 768w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-1146x1536.png 1146w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-1528x2048.png 1528w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-830x1113.png 830w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-230x308.png 230w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-350x469.png 350w, https://dgen.net/0/wp-content/uploads/2026/02/Screenshot-2026-02-20-at-15.35.23-480x643.png 480w" sizes="(max-width: 1910px) 100vw, 1910px" /></a></figure>



<p class="wp-block-paragraph">* Looking out at the hi-fi geek landscape, there is no end of completely stupid nonsense things people do (from £1,000 <a href="https://www.mcru.co.uk/product-category/hifi-cables/usb-cables-hifi-cables/">audiophile USB cables</a> to &#8216;<a href="https://forum.audiogon.com/discussions/does-raising-speaker-cables-off-the-floor-really-make-a-big-difference">elevated speaker cable risers</a>&#8216;), none of which make a single bean of difference to anything but your wallet. Once you&#8217;ve got a basic system in place by far the biggest differences you&#8217;ll be able to <em>actually hear</em> are (a) treating the room with sound insulation, and/or (b) treating the distribution, balance and EQ of the signal itself in your space, which is what I&#8217;m doing here.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7740</post-id>	</item>
		<item>
		<title>Data is everywhere, just not where we need it</title>
		<link>https://dgen.net/0/2025/07/07/data-is-everywhere-just-not-where-we-need-it/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Mon, 07 Jul 2025 07:59:49 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[data infrastructure]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7669</guid>

					<description><![CDATA[<img width="1024" height="683" src="https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-1024x683.jpg" class="attachment-large size-large wp-post-image" alt="AI generated image of people searching for data across patchwork fields made of charts and spreadsheets" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-1024x683.jpg 1024w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-300x200.jpg 300w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-768x512.jpg 768w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-830x553.jpg 830w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-230x153.jpg 230w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-350x233.jpg 350w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-480x320.jpg 480w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni.jpg 1200w" sizes="(max-width: 1024px) 100vw, 1024px" />We’ve never had more data. Some think it’s the new oil, the new gold, the new soil, something of a revolution. Is it? Or are [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="1024" height="683" src="https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-1024x683.jpg" class="attachment-large size-large wp-post-image" alt="AI generated image of people searching for data across patchwork fields made of charts and spreadsheets" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-1024x683.jpg 1024w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-300x200.jpg 300w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-768x512.jpg 768w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-830x553.jpg 830w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-230x153.jpg 230w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-350x233.jpg 350w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni-480x320.jpg 480w, https://dgen.net/0/wp-content/uploads/2025/07/blog-diejnwwni.jpg 1200w" sizes="(max-width: 1024px) 100vw, 1024px" />
<p class="wp-block-paragraph">We’ve never had more data. Some think it’s the new <a href="https://en.wikipedia.org/wiki/Clive_Humby" rel="noreferrer noopener" target="_blank">oil</a>, the new <a href="https://www.weforum.org/agenda/2011/11/data-is-the-new-gold" rel="noreferrer noopener" target="_blank">gold</a>, the new <a href="https://www.ted.com/talks/david_mccandless_the_beauty_of_data_visualization" rel="noreferrer noopener" target="_blank">soil</a>, something of a revolution. Is it? Or are we just still humans stumbling around in the dark?</p>



<p class="wp-block-paragraph">Earth observation satellites scan our planet, sensors (there are more sensors on Earth than there are people) track the movements of people and things, energy flows, air quality, water usage, and behaviours. Our global financial systems process billions of transactions a day. Most organisations, public and private, are drowning in dashboards, APIs, spreadsheets, data lakes, clouds, compute, applications, and now ‘ai’.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">“Every age thinks it’s the modern age…but this one really is”<br><a href="https://vimeo.com/ondemand/dreamsrewiredmovie" rel="noreferrer noopener" target="_blank">Dreams Rewired</a>, Manu Luksch</p>
</blockquote>



<p class="wp-block-paragraph">And yet, when we need to make decisions that matter — how to finance a green retrofit, where to send emergency flood support, or how to measure progress toward net zero, the data we need is often hard to access or nowhere to be found. Or it exists, but it’s in the wrong format, in the wrong place, scattered across organisations and systems, under the wrong licence, or wrapped around the wrong market incentives, or just poorly governed and hard to trust.</p>



<h4 class="wp-block-heading"><strong>Why is this important to our&nbsp;future?</strong></h4>



<p class="wp-block-paragraph">We’re in an era where our <a href="https://en.wikipedia.org/wiki/Financial_economics" rel="noreferrer noopener" target="_blank">financial economy</a> is demanding ‘quality’ data from the <a href="https://en.wikipedia.org/wiki/Real_economy" rel="noreferrer noopener" target="_blank">real economy</a>. Our financial systems have developed over centuries to measure, track, verify, use and report on the rate of change of ‘one dimension’: money. As we continue the shift to make our environment measurable, we must get the ‘exchange rate’ right between financial investment and environmental outcomes (climate, nature, air quality, water, biodiversity, and so on).</p>



<p class="wp-block-paragraph">Right now the ‘exchange rates’ are all over the place and, importantly, as we step forward we need to measure the rate of change of many parameters, not just one: we need a step-change in how we think about ‘data’ and data <em>sharing</em>.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">It’s hard to understate quite how far away the real economy is from generating financial-grade data</p>
</blockquote>



<p class="wp-block-paragraph">We’re still mostly in the 1970s. Environmental disclosures still rely on highly manual processes, despite widespread digitisation and <a href="https://ib1.org/ecosystem/2024-carbon-reporting-solutions-report/" rel="noreferrer noopener" target="_blank">hundreds of application vendors</a> in the market, it’s still mostly clipboards and spreadsheets or, for 99% of the world, nothing at all. This is not a problem of data scarcity, it’s a problem of <em>incentives, structure</em>, and <em>alignment</em>.</p>



<p class="wp-block-paragraph">We’ve built systems that are optimised for accumulation, not coordination. We have engineered data pipelines that extract value, but not the wiring to deliver reciprocity (shared benefits).</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">In the language of infrastructure: we’ve laid the cables, but we’ve neglected the grid</p>
</blockquote>



<p class="wp-block-paragraph">We are told to “make data-driven decisions” while simultaneously being denied the means to do so at scale. Meanwhile, we waste more time (and money, opportunity and emissions) trying to reconcile, reformat, clean, or even <em>find</em> the data than the actual decisions that we are trying to make.</p>



<p class="wp-block-paragraph">The result is a kind of systemic gaslighting: we pretend that the data is ‘there’ when what we really mean is that it <em>exists&nbsp;… </em>but <em>existing</em> is not the same as <em>usable</em>, and very far away from <em>trusted</em>. Just because something is stored on a server doesn’t mean it’s infrastructure. Just because it’s digital doesn’t mean it’s useful. Just because it’s available doesn’t mean it’s accessible.</p>



<p class="wp-block-paragraph">McKinsey (<a href="https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-data-driven-enterprise-of-2025" rel="noreferrer noopener" target="_blank"><em>The data-driven enterprise of 2025</em></a><em>) </em>suggests that data professionals still spend up to 80% of their time preparing data rather than using it. This is the same number I have from over 25 years ago.</p>



<h4 class="wp-block-heading">So where do we go from&nbsp;here?</h4>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">Data is everywhere but until it <strong>flows to where it’s needed</strong> (when it’s needed, and with the right context) we’re not building a digital future we’re just building more digital noise</p>
</blockquote>



<p class="wp-block-paragraph">We need to stop pretending that technology (including ai) alone will solve this. We must stop framing data as a ‘commodity’ to be owned and sweated, and start treating it as infrastructure to be governed.</p>



<p class="wp-block-paragraph">We must design for connection not monopoly control, for shared purpose not private hoarding. We must invest in the ‘boring’ bits: governance, legal standards, licensing, permission/consent, metadata, interoperability.</p>



<p class="wp-block-paragraph">This is the stuff that doesn’t make the headlines, but makes everything else work.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7669</post-id>	</item>
		<item>
		<title>Fair weather, foul weather: navigating to positive impact in turbulent times</title>
		<link>https://dgen.net/0/2025/04/06/fair-weather-foul-weather-navigating-to-positive-impact-in-turbulent-times/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Sun, 06 Apr 2025 09:00:00 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[Culture]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[Government]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7480</guid>

					<description><![CDATA[<img width="1024" height="575" src="https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-1024x575.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-1024x575.jpg 1024w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-830x466.jpg 830w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul.jpg 1372w" sizes="(max-width: 1024px) 100vw, 1024px" />The National Data Library can deliver its vision,but it must pivot to build trust in the age of today’s web This post builds on observations [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="1024" height="575" src="https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-1024x575.jpg" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-1024x575.jpg 1024w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-830x466.jpg 830w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul-480x270.jpg 480w, https://dgen.net/0/wp-content/uploads/2025/04/fair-foul.jpg 1372w" sizes="(max-width: 1024px) 100vw, 1024px" />
<h4 class="wp-block-heading has-text-color has-link-color wp-elements-ca7494eeb69ee3e17559faf176611278" id="fecf" style="color:#696969">The National Data Library can deliver its vision,<br>but it must pivot to build trust in the age of today’s web<a href="https://agentgav.medium.com/?source=post_page---byline--9ba4c150c175---------------------------------------"></a></h4>



<p class="wp-block-paragraph" id="41ee">This post builds on observations and conversations across government and industry (and internationally) since my previous post on “<a href="https://agentgav.medium.com/how-can-we-find-the-goldilocks-zone-of-our-national-data-infrastructure-f1eb055e1ba7">How can we find the Goldilocks Zone of our National Data Infrastructure?</a>”.</p>



<p class="wp-block-paragraph" id="a585">When we’re building into a future where technology has such clear benefits it is often hard to be heard above&nbsp;<em>the noise of</em>&nbsp;<em>the possible</em>. And yet I believe we must also ‘grasp the nettle’ regarding equally possible negative or unintended consequences. While we must not “stifle innovation and growth”, we also must ensure we don’t scuttle our ship in the process.</p>



<p class="wp-block-paragraph" id="4d7d">The first misconception I want to address is that&nbsp;<em>data is not a technology</em>.</p>



<p class="wp-block-paragraph" id="572f">Data is used to represent information, analysis, insights, opinions, facts, responsibilities and decisions. It carries many different kinds of&nbsp;<em>value</em>, as well as material&nbsp;<em>rights</em>&nbsp;and material&nbsp;<em>risks</em>. Data is used to&nbsp;<em>find things out</em>&nbsp;and to&nbsp;<em>make decisions</em>. To look into its past, data is the plural of&nbsp;<em>datum</em>, from Latin, meaning&nbsp;<em>something given</em>.</p>



<p class="wp-block-paragraph" id="40c9">I labour this point to make clear that it is not software (e.g. AI is software that uses and produces data, as are all algorithms codified in software) and it is also not hardware. A lot of debate about data (and AI in particular) seem to conflate these facts.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="a333">Treating data as if it were software is comparing apples and carts.</p>
</blockquote>



<h1 class="wp-block-heading" id="1d22">Context</h1>



<p class="wp-block-paragraph" id="9de7">Having been a tech entrepreneur for 30 years, I’ve sat in meetings with Silicon Valley investors where the “move fast and break things, then ask for forgiveness” mantra has been very present. Innovators love to build; building is fun and very rewarding — both intellectually and, sometimes, financially.</p>



<p class="wp-block-paragraph" id="c19e">It’s common to worry about the consequences later, even when ‘later’ can be measured in decades. Those raising alarm bells are often badged as ‘activists’. This is a label I’ve never felt helpful: we can draw parallels with the past when ‘health risks of smoking’, through to catastrophic climate change, risked people being boxed as ‘alarmist’ instead of ‘anxious-with-cause’.</p>



<p class="wp-block-paragraph" id="932e">I’ve always advocated for fair-weather innovation, while ensuring that we build in measures for foul weather. In the age of the web, commercial (and political) ambition can often be seduced by the fair-weather arguments, while policy is rarely able to move at the speed required to keep pace and safeguard us from foul-weather conditions.</p>



<p class="wp-block-paragraph" id="0610">A lot has changed since my&nbsp;<a href="https://agentgav.medium.com/">previous posts on data infrastructure</a>. We must now,&nbsp;<strong>right now</strong>,<strong>&nbsp;</strong>be proactive and preemptive to the fact that our threat model has changed (due to shifting geopolitical and technocratic-utopian positions). Foul weather is closer than we may have wished.</p>



<p class="wp-block-paragraph" id="be32"><em>Trust isn’t just a buzzword; it underpins our society and, in a digital age, this means addressing our data infrastructure, ensuring our&nbsp;</em><strong><em>safety</em></strong><em>, de-risking&nbsp;</em><strong><em>innovation</em></strong><em>&nbsp;and enabling&nbsp;</em><strong><em>growth</em></strong><em>&nbsp;in turbulent times. Trust helps us build all of these, for the long term.</em></p>



<h1 class="wp-block-heading" id="d4ac">Going from vision to implementation is hard</h1>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation.jpg"><img decoding="async" width="1024" height="192" src="https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-1024x192.jpg" alt="" class="wp-image-7484" srcset="https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-1024x192.jpg 1024w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-300x56.jpg 300w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-768x144.jpg 768w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-1536x288.jpg 1536w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-830x156.jpg 830w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-230x43.jpg 230w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-350x66.jpg 350w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation-480x90.jpg 480w, https://dgen.net/0/wp-content/uploads/2025/04/vision-implementation.jpg 1600w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>



<p class="wp-block-paragraph" id="6f90">There is a natural tendency towards overreach in most systems — this is a very human attribute. When trying to innovate, our bureaucratic systems can often feel frustrating (good entrepreneurs — both inside and outside of government — know how to navigate around, or sometimes ‘through’, such systems).</p>



<p class="wp-block-paragraph" id="d2da">Today, in 2025, with data&nbsp;<em>and</em>&nbsp;the web&nbsp;<em>and</em>&nbsp;AI, the pace and scale of impact outpaces and out-scales any other time in history. We can create a critical mass, or a critical&nbsp;<em>mess</em>.</p>



<p class="wp-block-paragraph" id="a773">To that end, I believe we must take steps to better&nbsp;<em>understand</em>&nbsp;and&nbsp;<em>balance</em>&nbsp;what is in front of us. When it comes to enabling data sharing, whether in finance, health, transport, energy, property, water, or across all research, we need to first take stock of something that is very hard to build and yet can be lost in the blink of an eye: trust.</p>



<p class="wp-block-paragraph" id="5c48">The National Data Library (NDL) represents significant&nbsp;<strong>intent</strong>&nbsp;from the UK Government to do data sharing differently, and we (citizens, consumers, businesses, sectors, markets, and the state) can all benefit from this. However,&nbsp;<strong>implementation really matters</strong>.</p>



<p class="wp-block-paragraph" id="392f">Icebreaker One has already made&nbsp;<a href="https://ib1.org/2025/01/28/our-recommendations-for-delivering-an-effective-national-data-library/">a strong case</a>&nbsp;(selected for publication by the Wellcome Trust) for the National Data Library to:</p>



<ol class="wp-block-list">
<li>Focus on defined <strong>users</strong> and <strong>use cases</strong> rather than datasets, just like any effective data infrastructure.</li>



<li>Begin life as a simple, decentralised version, that would curate and improve the <strong>discovery</strong> of, and <strong>timely access</strong> to, public sector data for research.</li>



<li>Experiment with more complex architectures for <strong>harmonising</strong> <strong>access</strong> to data drawn from across multiple government departments.</li>
</ol>



<p class="wp-block-paragraph" id="0c82">Cutting across all of this, the NDL&nbsp;<strong>must</strong>&nbsp;be built, from its core, in ways that&nbsp;<strong>engender trust</strong>. Whether consumer distrust, competitive interest or geopolitical threats, we must have in place the people, processes and protections to cement trust between businesses (b2b), with consumers (b2c), and with our citizens.</p>



<p class="wp-block-paragraph" id="0222">The NDL can still&nbsp;<strong>maintain its grand vision to improve outcomes for all</strong>&nbsp;of us, connecting data, rapidly unlocking insights, and leading the way.</p>



<p class="wp-block-paragraph" id="591c">More than its technical architecture,&nbsp;<strong>the</strong>&nbsp;<strong>nature of its funding and staffing will shape what it can achieve</strong>. I’d argue we can do more together, and move faster, with common principles and parallel actions than a large centralised effort. Not only should the data never be centralised (other than for the limited use cases that require that), but neither should the absolute control.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="ed9f">We can go far together if we each do one thing well.</p>
</blockquote>



<p class="wp-block-paragraph" id="49db">We can bind our work, together, with&nbsp;<strong>common principles and practices</strong>. There will be no ‘one hub’ — if you are a hub in a collection of hubs, you’re a node. Even a National Library is one node in a network of knowledge. There isn’t only one search engine in the world, nor will there be one AI.</p>



<p class="wp-block-paragraph" id="f1aa">We must also approach, with a clear perspective, that one-time broad-based consent is just&nbsp;<strong>one</strong>&nbsp;<strong>limited use case</strong>. It may apply to certain, relatively static, data but a different approach is required for highly variable data:&nbsp;<strong>data is rarely static</strong>. The conditions on which that ‘one-time’ consent, as we have also seen, will also change based on lived experience (e.g. changes in corporate and political governance).</p>



<p class="wp-block-paragraph" id="4b2f"><em>In a world of rapid change, we must pivot rapidly but<br>never forget the foundations of trust beneath our feet</em></p>



<p class="wp-block-paragraph" id="51c0">Building on the&nbsp;<a href="https://www.gov.uk/government/publications/smart-data-review">Smart Data</a>&nbsp;model, there are known ways to apply decentralised, user-controlled, real-time, granular consent. There are dynamic solutions&nbsp;<em>in place today</em>&nbsp;which enable peer-to-peer data sharing via secure&nbsp;<a href="https://en.wikipedia.org/wiki/API">APIs</a>. Such systems can include immediate revocation (by the user, or by a neutral governing entity/representative), and they are designed and built to enable cross-sector interoperability.</p>



<p class="wp-block-paragraph" id="4d5c">\Equally, such systems will not (and should not) be the approach for all use cases. What works will depend on the&nbsp;<strong>purpose</strong>&nbsp;(which will span personal, business, national, research as well as small, medium and large aggregate/collective datasets). What matters is how they are governed.</p>



<p class="wp-block-paragraph" id="b47b">This is where implementation matters. If we over-centralise and over-reach in our ambition we run the risk of the litany of failed ‘IT projects’ which have cost the taxpayer billions.</p>



<p class="wp-block-paragraph" id="eee8">I see many projects, even some with the word ‘governance’ in their titles, take a technology-led approach rather than a governance-led approach: data is not a technology—it enables insights about its subjects and those subjects have rights.</p>



<h1 class="wp-block-heading" id="68b7">Recommendations</h1>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="54b4"><strong>Without trust in the systems upon which we run our lives we will, at best, stifle innovation, productivity and growth. At worst, we risk undermining far more.</strong></p>
</blockquote>



<p class="wp-block-paragraph" id="2a5d">The good news is that we can run, at pace,&nbsp;<em>fast but not foolhardy</em>, to build the data infrastructure we need for today and scale for all our tomorrows, to deliver trust, ensure our safety and unlock the value of data for everyone.</p>



<p class="wp-block-paragraph" id="3888"><strong>Phase 1: Immediate reorientation on purpose and language (0–6 Months)</strong></p>



<p class="wp-block-paragraph" id="276d"><strong>Step 1: Transition the “Library Card” model to a Trust-based, scalable model</strong></p>



<ul class="wp-block-list">
<li><strong>Pivot from the concept of ‘library’ to a ‘web of interoperability and trust’ (WIT)</strong></li>
</ul>



<p class="wp-block-paragraph" id="e987">For example, announce an evolution from the “National Data Library” to something like a “Web of Interoperability and Trust” (WIT) or “National Data Web” or “Trusted Data Web”, which would align with work already in place in the financial sector and give more scope to connecting existing initiatives, including Smart Data, without being specific about technology preferences.</p>



<ul class="wp-block-list">
<li><strong>Define six exemplar use cases for pilot delivery in 2025</strong></li>
</ul>



<p class="wp-block-paragraph" id="ef7c">Pick six lighthouse use cases across sectors, assign to different entities for delivery, and shift governance to the model that best enables them (e.g. from “pre-approved datasets” to a federated trust framework where applicable).</p>



<p class="wp-block-paragraph" id="1925">Adopt an API-first architecture to allow controlled, on-demand data sharing. Use them to produce quantitative evidence as to the pros and cons of the approach.</p>



<p class="wp-block-paragraph" id="417f"><strong>Step 2: Introduce an adaptive Smart Data consent framework (6–12 months)</strong></p>



<ul class="wp-block-list">
<li><strong>Develop and mandate common principles</strong></li>
</ul>



<p class="wp-block-paragraph" id="2714">Common principles should include application for ‘Data Consent/Permission’ for consumers, SMEs, researchers, businesses and government departments to view, grant, and revoke access to datasets. These should be evidenced through use cases with specific cost benefit and threat analysis.</p>



<ul class="wp-block-list">
<li><strong>Require and mandate data best practices</strong></li>
</ul>



<p class="wp-block-paragraph" id="8ddc">Require that all third-party users (e.g. AI developers, financial institutions)&nbsp;<em>justify the minimum data required per use case</em>. Mandate that every material access request is logged, auditable, and policy-compliant (e.g. GDPR, Data Bill, and related policies). Where applicable, develop formal Schemes that codify multilateral contracts and enforce them. Note that Schemes can also be industry-led and voluntary, with appropriate governance: political signalling can be an efficient way to accelerate implementation.</p>



<p class="wp-block-paragraph" id="ffe4"><strong>Phase 2: Build systemic trust (6–18 Months)</strong></p>



<p class="wp-block-paragraph" id="b27b"><strong>Step 1: Shift to an API-enabled Data Access Model (including trust frameworks) based on user needs</strong></p>



<p class="wp-block-paragraph" id="dbe9">In this instance ‘API-driven’ is an architectural choice aligned with the web, not a specific technology, that enables both interoperability and controls to be implemented. Other use cases won’t need ‘APIs’ (e.g. a CSV file of Open Data), but where security and access control are required, any technical solution must be able to operate at web scale. Key is the development of the governance mechanisms that help implement trust frameworks.</p>



<ul class="wp-block-list">
<li><strong>Support development of sandboxes</strong></li>
</ul>



<p class="wp-block-paragraph" id="84bb">Support the rapid, cross-sector creation of sandbox environments with political and financial support where required.</p>



<ul class="wp-block-list">
<li><strong>Support open communication, transparency, and build collaboration <em>and reciprocity</em> with a broad stakeholder group. Address business, public and government skills and knowledge gaps.</strong></li>
</ul>



<p class="wp-block-paragraph" id="394a">Embed open communications, transparency and reciprocity into all programmes. Demonstrate to businesses and consumers that technologies such as AI can deliver value without undermining trust. This can be achieved by facilitating co-design across the value chain (e.g. govt, industry and end users, whether b2b or b2c)</p>



<ul class="wp-block-list">
<li><strong>Create systemic links with digital identity developments</strong></li>
</ul>



<p class="wp-block-paragraph" id="5ac5">Incorporate systems-level authentication (e.g. OAuth-based which is already ubiquitous) — data access should be controlled via digital identity-linked permissions for companies and research organisations. This is aligned with the Data Bill and FCA approaches. Digital identity is a huge topic which I do not want to dive into here, but I do assume that it will (also) be federated (there should and will be no ‘one place’ for it).</p>



<p class="wp-block-paragraph" id="cb97"><strong>Step 2: Maximise privacy enhancement for people and businesses (e.g. SMEs)</strong></p>



<ul class="wp-block-list">
<li><strong>Create mandates and incentives for privacy enhancement</strong></li>
</ul>



<p class="wp-block-paragraph" id="a170">Broaden and define Schemes to enable ‘Access Rulesets’ and enforce data-minimisation principles for citizens, consumers and businesses (including b2b SME data sharing), so datasets can be queried without bulk transfers (e.g. an app can check fact without revealing the underlying data, e.g. “are they over 18 — yes” not “what’s their birthdate?”)</p>



<p class="wp-block-paragraph" id="f7e0"><strong>Phase 3: National Smart Data Infrastructure (18–36 Months)</strong></p>



<p class="wp-block-paragraph" id="9c1a"><em>(yes, this may feel ambitious: why shouldn’t it be this rapid?)</em></p>



<p class="wp-block-paragraph" id="3427"><strong>Step 1: Legislate Data Interoperability</strong></p>



<ul class="wp-block-list">
<li><strong>Mandate interoperable systems where consent/permission or access control is required</strong></li>
</ul>



<p class="wp-block-paragraph" id="37ed">Draft legislation ensuring every public-sector dataset must be ‘API-accessible’ under standardised, interoperable formats. As noted, not all public-sector data needs an API. In fact Open Data should be made available in any way that makes it discoverable and usable, and even CSV files can be catalouged by other systems and made ‘API accessible’. However, where some form of access control is needed, secure APIs are the standard that works for the web (e.g. Open Banking has 12 million monthly active users across the UK).</p>



<p class="wp-block-paragraph" id="5c3a">Also note that interoperability at the API level does not mean that all internal systems must do the same thing in the same way: data can be repurposed and presented&nbsp;<em>without rebuilding entire estates</em>&nbsp;(this will create an incentive for doing so over time, but it doesn’t need to happen first). Interoperability and decentralisation can work together, with appropriate governance, to&nbsp;<em>enhance</em>&nbsp;competition.</p>



<ul class="wp-block-list">
<li><strong>Mandate open access and empower regulators to enforce compliance</strong></li>
</ul>



<p class="wp-block-paragraph" id="ed97">Mandate open&nbsp;<strong>access</strong>&nbsp;to government datasets where possible, while protecting sensitive data via consent-based permissions, and democratically set rules. Pick regulators or code bodies to oversee the development of the specific rules and compliance required, including modes of redress. Note that&nbsp;<a href="https://ib1.org/open-shared-closed/">open&nbsp;<strong>access</strong>&nbsp;and Open Data</a>&nbsp;are different things.</p>



<p class="wp-block-paragraph" id="a9ea"><strong>Step 2: Scale the Model Beyond Government Data</strong></p>



<ul class="wp-block-list">
<li><strong>Support the development of connected demonstrators and pilots</strong></li>
</ul>



<p class="wp-block-paragraph" id="4694">Launch pilots&nbsp;<em>with commercial ecosystems</em>&nbsp;to enable interoperability (e.g. real estate, sustainability finance, public health). This includes cross-border and global data-sharing ecosystems (e.g. finance, goods).</p>



<ul class="wp-block-list">
<li><strong>Enable interoperability beyond the UK, within the desired framework</strong></li>
</ul>



<p class="wp-block-paragraph" id="988b">Develop cross-border data-sharing agreements (‘Schemes’). Ensure interoperability with international frameworks (e.g. EU Digital Identity Wallet, OECD AI Data Principles and related emerging programmes). Ensure every data use and dataset are AI-ready and privacy-compliant via automated monitoring and governance.</p>



<h1 class="wp-block-heading" id="9765">Summary</h1>



<p class="wp-block-paragraph" id="c815"><strong>Strategic Benefits</strong></p>



<ul class="wp-block-list">
<li><strong>Accelerates mission-driven government</strong>: Enables implementation of the government’s five missions via trusted, scalable data access.</li>



<li><strong>Supports economic growth</strong>: Unlocks interoperability for data-driven innovation across UK sectors.</li>



<li><strong>Protects society through accountable systems:</strong> Ensures that data-enabled systems are governed with clear and enforceable safeguards. Enables a coherent approach to data sovereignty across our economy and society, to minimise the risks of misuse and systemic harms in a rapidly evolving landscape.</li>



<li><strong>Future-proofs data governance</strong>: Aligns with existing data sharing frameworks, and with evolving standards for AI training, licensing, and consent. Licensing will be a cornerstone in all future data work whether AI-linked or not.</li>



<li><strong>Embeds assurability at scale</strong>: Operationalises assurability across domains.</li>
</ul>



<h2 class="wp-block-heading" id="747e"><strong>Five WIT principles (for discussion)</strong></h2>



<ol class="wp-block-list">
<li><strong>Interoperability by design</strong>: Common standards, APIs, and metadata frameworks to ensure frictionless cross-sector data use.</li>



<li><strong>Trust infrastructure</strong>: Consent-based access, verified credentials, and relevant-time provenance tracking.</li>



<li><strong>Federated governance</strong>: Sectoral autonomy with shared rules, coordinated through a Web of Interoperability and Trust.</li>



<li><strong>User empowerment</strong>: Individuals and organisations have control their data-sharing preferences. Strong governance-led approached apply to aggregate data, with the option to revoke.</li>



<li><strong>Composable architecture</strong>: Modular, user needs based and cross-sector enabling use cases, using sharable registries, vocabularies, and open interfaces.</li>
</ol>



<p class="wp-block-paragraph" id="9e1d"><strong>NB</strong>: This post contains (as-always) personal opinions and thinking-in-progress (strong opinions, weakly held) as I navigate through the maze(s) of data governance. In amongst many experiences, I sat on the MiData energy sector board; co-chaired the creation of the&nbsp;<a href="https://www.openbanking.org.uk/">Open Banking Standard</a>; was founding CEO of the&nbsp;<a href="https://theodi.org/">Open Data Institute</a>; co-Chaired of the Smart Data Council. I run a non-profit (<a href="http://ib1.org/">IB1.org</a>) working on data governance at sector, national and international scale.</p>



<p class="wp-block-paragraph" id="7ea0">With thanks to Jack, Peter, Chris, Frank, Jeni, Simon, Julia, Kathryn, and many others who have helped shape my thinking on this.</p>



<p class="wp-block-paragraph"><a href="https://medium.com/tag/data-infrastructure?source=post_page-----9ba4c150c175---------------------------------------"></a></p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7480</post-id>	</item>
		<item>
		<title>How can we find the Goldilocks Zone of our National Data Infrastructure?</title>
		<link>https://dgen.net/0/2024/10/13/how-can-we-find-the-goldilocks-zone-of-our-national-data-infrastructure/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Sun, 13 Oct 2024 01:01:00 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[Culture]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[Government]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7542</guid>

					<description><![CDATA[<img width="1024" height="571" src="https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-1024x571.webp" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-1024x571.webp 1024w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-300x167.webp 300w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-768x428.webp 768w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-830x463.webp 830w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-230x128.webp 230w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-350x195.webp 350w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-480x268.webp 480w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw.webp 1400w" sizes="(max-width: 1024px) 100vw, 1024px" />(please note my disclosures at the end of this post) This post contains (as-always) personal opinions and thinking-in-progress (strong opinions, weakly held) as I navigate [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="1024" height="571" src="https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-1024x571.webp" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-1024x571.webp 1024w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-300x167.webp 300w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-768x428.webp 768w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-830x463.webp 830w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-230x128.webp 230w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-350x195.webp 350w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw-480x268.webp 480w, https://dgen.net/0/wp-content/uploads/2025/04/1_TRAvxG7V_q3WD4P_5YoHXw.webp 1400w" sizes="(max-width: 1024px) 100vw, 1024px" />
<p class="wp-block-paragraph"><em>(please note my disclosures at the end of this post)</em></p>



<p class="wp-block-paragraph" id="bf5c">This post contains (as-always) personal opinions and thinking-in-progress (strong opinions, weakly held) as I navigate through the maze(s) of data governance. Persistent in my questions are how we apply the&nbsp;<a href="https://en.wikipedia.org/wiki/Goldilocks_principle" rel="noreferrer noopener" target="_blank">Goldilocks principle</a>&nbsp;of governance vs innovation: to remain flexible and avoid brittleness.</p>



<p class="wp-block-paragraph" id="8af0">Given the conversations I’m in at the moment I believe it very important to have as much debate as openly as possible, as this impacts&nbsp;<em>everyone</em>.</p>



<p class="wp-block-paragraph" id="50e1">Here’s a question:</p>



<p class="wp-block-paragraph" id="405c">How should the UK implement its<strong>&nbsp;National Data Infrastructure</strong>&nbsp;so that it provides consistent control, sharing, and security for data, much like other public infrastructures such as roads and utilities?</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="82b4">“Everything should be as simple as it can be, but not simpler”<br>[often attributed to Einstein]</p>
</blockquote>



<p class="wp-block-paragraph" id="2562">Having initiated ‘<a href="https://theodi.org/insights/reports/who-owns-our-data-infrastructure/" rel="noreferrer noopener" target="_blank">data as infrastructure</a>’ at a political level in the UK in 2013, I’ve been watching and learning on this for a long time. We’ve made remarkable progress in some areas, less so in others.</p>



<p class="wp-block-paragraph" id="4def">Let’s explore, starting with some&nbsp;<strong>lessons learned</strong>.</p>



<p class="wp-block-paragraph" id="bcef">One immediate reflection is that as over 60 countries moved to copy the Open Banking Standard, those who took only ‘parts’ of the system tended to experience less ideal outcomes (to the point that they often add them back in later to help course-correct — most notable are those who thought this was ‘just a tech problem’ and only took the open API principles).</p>



<p class="wp-block-paragraph" id="0b11">We can look to past UK data initiatives like MiData and Open Banking and potentially infer that voluntary-only initiatives and centralisation do not work, and that the decentralised nature of Open Banking was more successful. However, these are shallow reflections.</p>



<p class="wp-block-paragraph" id="89bc">We can point to three factors beyond centralised or voluntary which are dependent on the&nbsp;<strong>use case</strong>:</p>



<ol class="wp-block-list">
<li><strong>Market incentives</strong>: there must be an economic argument that policy can then amplify or mandate. If there is no financial incentive, there will be no movement (regardless of central vs decentralised, mandate or not — mandates are also often ignored). Midata was mostly tech-led, Open Banking was use-case led.</li>



<li><strong>Removal of friction</strong>: Removing transactional friction may seem like something everyone wants, but not if your current business model relies on it. There must be “something in it” for everyone, or at least a path to cost reduction or a new business model. Removing friction can help everyone go together: this is never a ‘technology problem’ (e.g. absence of a data ontology).</li>



<li><strong>Mandates</strong>: if the friction is ‘too high’, regulatory intervention is necessary to mandate participation and move the market. However, if the market can demonstrate self-initiation, then ‘endorsement’ from government can be sufficient to drive impact. Value creation must be visible in both cases.</li>
</ol>



<p class="wp-block-paragraph" id="8ad9">I believe that we need to embrace these factors in our&nbsp;<strong>systems design</strong>.</p>



<p class="wp-block-paragraph" id="751e">We need to:</p>



<ol class="wp-block-list">
<li>work out where the lines are drawn between <strong>central</strong>, <strong>pre-competitive</strong> and <strong>competitive</strong> areas;</li>



<li>ask what the role of regulation is, and at what <strong>granularity</strong></li>



<li>query how things can be <strong>implemented</strong> in a way that humans (and machines) can and want to <strong>adopt</strong></li>



<li>ensure those governing, operating and participating can be <strong>helped</strong> in their <strong>assessments</strong> of compatibility and interoperability</li>



<li>work out how to <strong>prioritise</strong> and create clear (and stable) <strong>roadmaps</strong> that enable investment to be made</li>
</ol>



<p class="wp-block-paragraph" id="3bb1">I believe that we can build on the&nbsp;<strong>success of sector-specific approaches</strong>:</p>



<p class="wp-block-paragraph" id="6c2e">The Open Banking model’s success lies precisely in its sector-specific, incremental approach. It focused on the unique needs of banking, where security, standardisation, and customer trust were paramount.</p>



<p class="wp-block-paragraph" id="4135">Copying the Open Banking model into other sectors (e.g., energy, transport, health) isn’t about duplication but about&nbsp;<strong>applying tested frameworks tailored to each industry</strong>.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="5d2e">Without considering the market incentives for participation we risk techno-utopian thinking</p>
</blockquote>



<p class="wp-block-paragraph" id="078d">Instead of trying to create a complex, overarching architecture that risks being too broad, a sectoral approach allows for flexibility and adaptation to industry-specific challenges. This carries a risk of fragmentation, and equally a potential to&nbsp;<strong>mandate cross-sector interoperability</strong>&nbsp;without defining exactly what this means in detail for everyone. The risk of push back on over-reach is material and catastrophic (in terms of adoption, if it fails). Further, market-incentives will be market-specific.</p>



<h2 class="wp-block-heading" id="2abc">Avoiding Over-Standardisation</h2>



<p class="wp-block-paragraph" id="593d">National Data Architecture risks over-standardisation and could stifle innovation instead of enhancing it. Different sectors have wildly varying levels of data maturity, hugely variable data governance needs and challenges, and a one-size-fits-all approach is highly likely to impose unnecessary constraints on sectors that are not as ready for them.</p>



<p class="wp-block-paragraph" id="d6d9">For example, imposing the level of data governance on the industrial sector that is required in the financial sector is (today) not realistic. We are, however, on the frontline of that journey with ESG reporting today, and it highlights the complexity of that real-financial sector bridging. Incremental improvements, like extending Open Banking principles to energy or transport can allow industries to evolve organically while keeping governance controls and security as a priority.</p>



<h2 class="wp-block-heading" id="fb4b">Pragmatism of the Incremental Approach</h2>



<p class="wp-block-paragraph" id="39ae">The incremental, domain-by-domain approach may seem less ambitious, but it offers a&nbsp;<strong>practical pathway to innovation that can be adopted today</strong>. Trying to design a top-down, comprehensive national architecture from the outset risks paralysis by analysis and over-planning. Learning from Open Banking and rolling out smart data initiatives sector-by-sector allows for continuous improvement and responsiveness to real-world feedback, which may be more effective than a sweeping, coordinated architecture.</p>



<h2 class="wp-block-heading" id="6025">Interoperability Requires Industry Engagement</h2>



<p class="wp-block-paragraph" id="1334">Interoperability relies on industry engagement. This is best fostered through practical, sector-specific initiatives like Open Banking. Imposing an overarching system from above risks of alienating key industry stakeholders, who may resist changes that threaten their business models (this happens in every sector already, today). Open Banking’s success came from the&nbsp;<strong>balance</strong>&nbsp;of regulatory oversight and industry cooperation, a formula that can be replicated in other sectors.</p>



<h2 class="wp-block-heading" id="2e96">Market Failures Can Be Addressed Incrementally</h2>



<p class="wp-block-paragraph" id="e3fc">There are (always) risks of market failures such as data hoarding (castle &amp; moat is still the prevalent investment model for data businesses). These issues should be tackled incrementally through sector-specific mandates rather than a top-down architecture, but can be accelerated with top-down principles.</p>



<p class="wp-block-paragraph" id="32f8">The competition fostered by Open Banking and similar initiatives already shows promise in tackling data monopolies. An incremental, practical approach&nbsp;<strong>allows policymakers to address market failures as they emerge</strong>, rather than trying to solve all potential problems with a one-time top-down design.</p>



<h2 class="wp-block-heading" id="1fee">Trust is Earned, Not Imposed</h2>



<p class="wp-block-paragraph" id="ccd9">Trust in data systems cannot be imposed from the top. While Open Banking was catalysed by regulation, it earned user trust through transparency, security, and gradual adoption, not through a top-down imposition. Similarly, rolling out frameworks sector by sector allows consumers, businesses and citizens to see the benefits and gradually gain confidence in the approach. Attempting to ‘mandate trust’ top-down could backfire, especially in sectors like health, where data privacy concerns are particularly sensitive.</p>



<p class="wp-block-paragraph" id="8ca2">At IB1, our&nbsp;<a href="https://ib1.org/definitions/trust-framework/" rel="noreferrer noopener" target="_blank">Trust Frameworks</a>&nbsp;are one tool (of many) that can help foster multilateral collaboration, building on Open Banking principles.</p>



<h2 class="wp-block-heading" id="ec31">Decentralisation Encourages Innovation</h2>



<p class="wp-block-paragraph" id="9288">The&nbsp;<strong>decentralised, minimised</strong>&nbsp;and&nbsp;<strong>pre-competitive</strong>&nbsp;nature of Open Banking has led to its adoption and innovation. A large, centralised approach would have risked locking in certain standards or technological pathways that could hinder future innovations. Allowing sectors to develop their own interoperable standards fosters a more competitive, flexible landscape, where innovations in one sector can inform developments in another, without being dictated by a single framework.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph" id="a682">Data governance should aim to balance impact on rights and security while minimising its own footprint and reach</p>
</blockquote>



<p class="wp-block-paragraph" id="f892">While the idea of a unified, overarching data framework may sound appealing in theory, in practice it would risk being too rigid, slow to adapt, and detached from the unique needs of individual sectors. A more pragmatic approach — building on the lessons of Open Banking and extending these principles to other industries — may offer the best balance of innovation, security, and user control.</p>



<p class="wp-block-paragraph" id="3d6c">Please feel free to comment, or message me (via&nbsp;<a href="https://www.linkedin.com/in/gavinstarks" rel="noreferrer noopener" target="_blank">LinkedIn</a>&nbsp;or directly)</p>



<p class="wp-block-paragraph" id="741b"><strong>Disclosure</strong>: I sat on the MiData energy sector board (mostly tearing my hair out on these points); co-chaired the creation of the&nbsp;<a href="https://www.openbanking.org.uk/" rel="noreferrer noopener" target="_blank">Open Banking Standard</a>&nbsp;(through which I learned so many lessons it could fill a book or two); was founding CEO of the&nbsp;<a href="https://theodi.org/" rel="noreferrer noopener" target="_blank">Open Data Institute</a>; am co-Chair of the Smart Data Council, and run a non-profit (<a href="http://ib1.org/" rel="noreferrer noopener" target="_blank">IB1.org</a>) working on data governance at sector and national scale.</p>



<p class="wp-block-paragraph" id="f6e4">Thanks to Chris, Frank, Paul, Hadley and others for their feedback and inputs.</p>



<p class="wp-block-paragraph" id="08c7"><strong>Useful links</strong></p>



<p class="wp-block-paragraph" id="3687">Lessons learned from Gaia-X Data Spaces&nbsp;<a href="https://www.sitra.fi/en/articles/eight-lessons-from-building-data-spaces/" rel="noreferrer noopener" target="_blank">https://www.sitra.fi/en/articles/eight-lessons-from-building-data-spaces/</a></p>



<p class="wp-block-paragraph" id="bc82">ODI on Data Institutions<br><a href="https://theodi.org/insights/projects/rd-data-institutions/" rel="noreferrer noopener" target="_blank">https://theodi.org/insights/projects/rd-data-institutions/</a></p>



<p class="wp-block-paragraph" id="4328">Icebreaker One on how it implements data sharing<br><a href="https://ib1.org/what-we-do" rel="noreferrer noopener" target="_blank">https://ib1.org/what-we-do</a></p>



<p class="wp-block-paragraph" id="8e21">Open Banking (implementation entity)<br><a href="https://openbanking.org.uk/" rel="noreferrer noopener" target="_blank">https://openbanking.org.uk</a></p>



<p class="wp-block-paragraph">Additional narrative on cities<br><a href="https://agentgav.medium.com/the-porous-city-92ae986cd43c">https://agentgav.medium.com/the-porous-city-92ae986cd43c</a><a href="https://agentgav.medium.com/?source=post_page---byline--f1eb055e1ba7---------------------------------------"></a></p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7542</post-id>	</item>
		<item>
		<title>Diome: definition</title>
		<link>https://dgen.net/0/2023/09/12/diome-definition/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Tue, 12 Sep 2023 12:56:00 +0000</pubDate>
				<category><![CDATA[data]]></category>
		<category><![CDATA[Environment]]></category>
		<category><![CDATA[research]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=6687</guid>

					<description><![CDATA[<img width="881" height="1024" src="https://dgen.net/0/wp-content/uploads/2023/09/diome-881x1024.png" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2023/09/diome-881x1024.png 881w, https://dgen.net/0/wp-content/uploads/2023/09/diome-258x300.png 258w, https://dgen.net/0/wp-content/uploads/2023/09/diome-768x892.png 768w, https://dgen.net/0/wp-content/uploads/2023/09/diome-1322x1536.png 1322w, https://dgen.net/0/wp-content/uploads/2023/09/diome-830x964.png 830w, https://dgen.net/0/wp-content/uploads/2023/09/diome-230x267.png 230w, https://dgen.net/0/wp-content/uploads/2023/09/diome-350x407.png 350w, https://dgen.net/0/wp-content/uploads/2023/09/diome-480x558.png 480w, https://dgen.net/0/wp-content/uploads/2023/09/diome.png 1507w" sizes="(max-width: 881px) 100vw, 881px" />Diome [noun] A data biome that represents a temporal cluster of data from which specific insights can be learned, analysed and/or derived. Discussion This is [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="881" height="1024" src="https://dgen.net/0/wp-content/uploads/2023/09/diome-881x1024.png" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2023/09/diome-881x1024.png 881w, https://dgen.net/0/wp-content/uploads/2023/09/diome-258x300.png 258w, https://dgen.net/0/wp-content/uploads/2023/09/diome-768x892.png 768w, https://dgen.net/0/wp-content/uploads/2023/09/diome-1322x1536.png 1322w, https://dgen.net/0/wp-content/uploads/2023/09/diome-830x964.png 830w, https://dgen.net/0/wp-content/uploads/2023/09/diome-230x267.png 230w, https://dgen.net/0/wp-content/uploads/2023/09/diome-350x407.png 350w, https://dgen.net/0/wp-content/uploads/2023/09/diome-480x558.png 480w, https://dgen.net/0/wp-content/uploads/2023/09/diome.png 1507w" sizes="(max-width: 881px) 100vw, 881px" />
<p class="has-cyan-bluish-gray-background-color has-background has-medium-font-size wp-block-paragraph"><strong>Diome</strong> <br><em>[noun]</em> <br>A data biome that represents a temporal cluster of data from which specific insights can be learned, analysed and/or derived.</p>



<p class="wp-block-paragraph"></p>



<h4 class="wp-block-heading"><strong>Discussion</strong></h4>



<p class="wp-block-paragraph">This is public on <a href="https://www.linkedin.com/feed/update/urn:li:activity:7107443674887634944">LinkedIn</a> (open <a href="https://docs.google.com/document/d/1kqc9-LERkX4g6JUqY3-rUq9genEi_9AHxp0iunXbJOI/edit">gdoc here</a> if you&#8217;d like to contribute)</p>



<ul class="wp-block-list">
<li>when training AI, if you have a load of similar diomes you&#8217;ll end up with monocultural outcomes.</li>



<li>in the same way, &#8216;monoculture&#8217; biomes means you cannot have the degree of biodiversity to sustain a planet, if you don&#8217;t have enough diomes you wont be able to represent the richness of our world (natural and human)</li>



<li>ensure that the diome has as complete a representation of the system as possible, with appropriate granularity, resolution, quality, volume and systems ontology?</li>
</ul>



<p class="wp-block-paragraph">Builds on the definition of <a href="https://en.wikipedia.org/wiki/Biome">Biome</a></p>



<p class="wp-block-paragraph">&#8220;A <strong>biome</strong> is a biogeographical unit consisting of a biological community that has formed in response to the physical environment in which they are found and a shared regional climate. Biomes may span more than one continent. Biome is a broader term than habitat and can comprise a variety of habitats.&#8221;</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">6687</post-id>	</item>
		<item>
		<title>Lessons from an Emergency: Achieving Data Readiness in Challenging Times</title>
		<link>https://dgen.net/0/2023/07/19/lessons-from-an-emergency-achieving-data-readiness-in-challenging-times/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Wed, 19 Jul 2023 18:59:59 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[health]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=6474</guid>

					<description><![CDATA[<img width="960" height="540" src="https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post.png" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post.png 960w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-300x169.png 300w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-768x432.png 768w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-830x467.png 830w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-230x129.png 230w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-350x197.png 350w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-480x270.png 480w" sizes="(max-width: 960px) 100vw, 960px" />This insightful report, from the Royal Societies DELVE initiative, &#8220;Data Readiness: Lessons from an Emergency&#8221; delves into the crucial role of data in emergency situations [&#8230;]]]></description>
										<content:encoded><![CDATA[<img width="960" height="540" src="https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post.png" class="attachment-large size-large wp-post-image" alt="" style="float:left; margin:0 15px 15px 0;" decoding="async" srcset="https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post.png 960w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-300x169.png 300w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-768x432.png 768w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-830x467.png 830w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-230x129.png 230w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-350x197.png 350w, https://dgen.net/0/wp-content/uploads/2023/07/blog-delve-post-480x270.png 480w" sizes="(max-width: 960px) 100vw, 960px" />
<p class="wp-block-paragraph">This insightful report, from the Royal Societies DELVE initiative, &#8220;<a href="https://rs-delve.github.io/reports/2020/11/24/data-readiness-lessons-from-an-emergency.html">Data Readiness: Lessons from an Emergency</a>&#8221; delves into the crucial role of data in emergency situations and highlights valuable lessons learned. Drawing from real-life experiences, it emphasises the importance of being prepared to leverage data effectively when faced with unexpected challenges.</p>



<p class="wp-block-paragraph"><a href="http://rs-delve.github.io/people.html">The initiative</a>&nbsp;has gathered experience with emergency situations and stresses the significance of having a data-driven approach. It highlights the need for organisations to recognise the value of data and incorporate it into their decision-making processes. By doing so, organisations can gain critical insights that help them respond swiftly and effectively.</p>



<p class="wp-block-paragraph">The report outlines key factors that contribute to successful data readiness, specifically </p>



<ul class="wp-block-list">
<li>the significance of investing in <strong>data infrastructure</strong></li>



<li>developing <strong>a holistic approach</strong> including tools, systems, and processes, to ensure the availability, accessibility, and quality of data</li>



<li>that data readiness is <strong>not solely a technical issue</strong> but also requires <strong>organisational</strong> commitment and <strong>cultural</strong> transformation.</li>
</ul>



<p class="wp-block-paragraph">It stresses the importance of collaboration and knowledge sharing between different stakeholders involved in emergency response efforts, highlights the need for establishing partnerships and creating platforms that facilitate <strong>data sharing</strong> and <strong>interoperability</strong>: that through open collaboration, organisations can harness the power of collective intelligence and make informed decisions based on comprehensive and up-to-date information.</p>



<p class="wp-block-paragraph">It touches upon the ethical considerations surrounding data usage in emergency situations, emphasising the need for transparency, privacy protection, and responsible <strong>data</strong> <strong>governance</strong>. By adhering to ethical guidelines, organisations can build trust with the public and ensure that data is used for the benefit of affected communities.</p>



<p class="wp-block-paragraph">It offers valuable insights into achieving data readiness in emergency scenarios and underscores the significance of investing in data infrastructure, fostering collaboration, and upholding ethical standards. </p>



<p class="wp-block-paragraph">Summary of key elements:</p>



<ol class="wp-block-list">
<li><strong>Importance of prepared data systems:</strong> Having well-prepared data systems is crucial for effective emergency response. It enables timely access to relevant data, which is vital for decision-making and coordination.</li>



<li><strong>Data availability</strong>: Ensuring data availability is essential during emergencies. It involves having data collection mechanisms in place and establishing protocols for data sharing among relevant stakeholders.</li>



<li><strong>Data accessibility</strong>: Easy and secure access to data is critical for timely decision-making. This requires establishing appropriate data access controls, and considering data privacy and security concerns.</li>



<li><strong>Data quality</strong>: Data quality is essential for reliable analysis and decision-making. Implementing data quality assurance measures and validation processes can help maintain accurate and reliable data during emergency situations.</li>



<li><strong>Interoperability</strong>: Ensuring interoperability among different data systems and platforms is crucial for effective coordination among various entities involved in emergency response. This facilitates seamless data exchange and collaboration.</li>



<li><strong>Standardised approaches</strong>: Implementing standardised approaches for data collection, sharing, and analysis promotes consistency and efficiency in emergency response efforts. This includes adopting common data formats, protocols, and procedures.</li>



<li><strong>Coordination and collaboration</strong>: Effective coordination and collaboration among stakeholders involved in emergency response are essential. This involves sharing data, aligning efforts, and establishing clear communication channels to maximise the impact of data-driven decision-making.</li>
</ol>



<p class="wp-block-paragraph">This very much echoes our experiences in developing <a href="https://dgen.net/0/d0-principles-for-global-data-infrastructure/" data-type="page" data-id="5726">data infrastructure</a> and the <a href="https://dgen.net/0/2020/04/01/data-governance-how-to-move-fast-and-not-break-things/" data-type="post" data-id="4201">data triage</a> process.</p>



<figure class="wp-block-image size-full"><a href="https://dgen.net/0/2020/04/01/data-governance-how-to-move-fast-and-not-break-things/"><img decoding="async" width="960" height="540" src="https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance.jpg" alt="" class="wp-image-4207" srcset="https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance.jpg 960w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-300x169.jpg 300w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-768x432.jpg 768w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-830x467.jpg 830w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-230x129.jpg 230w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-350x197.jpg 350w, https://dgen.net/0/wp-content/uploads/2020/04/Data-Emergency-—-triage-_-governance-480x270.jpg 480w" sizes="(max-width: 960px) 100vw, 960px" /></a></figure>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">6474</post-id>	</item>
		<item>
		<title>On data: where is it and what can we do with it?</title>
		<link>https://dgen.net/0/2023/05/05/on-data-where-is-it-and-what-can-we-do-with-it/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Fri, 05 May 2023 01:01:00 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[Government]]></category>
		<category><![CDATA[stuff]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=7556</guid>

					<description><![CDATA[From a discussion with a non-technical board which I was helping recently There was confusion around ‘where is the data?’, ‘who owns what?’ and ‘what [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph"><em>From a discussion with a non-technical board which I was helping recently</em></p>



<p class="wp-block-paragraph" id="bbca">There was confusion around ‘where is the data?’, ‘who owns what?’ and ‘what can be done with it?’.</p>



<p class="wp-block-paragraph" id="cd3f">My synopsis is that:</p>



<p class="wp-block-paragraph" id="d4dd"><strong>The ‘data gap’ is usually leadership<br></strong>Data governance needs to be taken seriously at the C-suite, management and internal processes. Not doing so both creates risks and misses opportunities. This must be addressed ‘today’.</p>



<ol class="wp-block-list">
<li><strong>Legal rules need to better balance risks and benefits</strong><br>There are likely areas of legal exposure on contracts that must be (re)thought through in a way that both protects the organisation <em>and</em> helps to unlock innovation through data sharing. Often the default is too restrictive and/or misses entire categories of risk.</li>



<li><strong>Company policies must be enforceable, monitored and applied<br></strong>Organisations should use procurement and contracting processes and ensure that they are fit for purpose, and have standard operating procedures for data governance. This should include clear definitions of <em>who</em> is responsible (e.g. ‘Data Controller’, Chief Data Officer), for <em>what</em> areas and purposes, and <em>how</em> data processing will be managed. All third-party services must contain clear definitions of IP, security, support, and maintenance (even if some services are offered for ‘free’).</li>
</ol>



<p class="wp-block-paragraph" id="1d7e">One issue I heard a lot of confusion about was the ‘location’ of data.<br>Its location can be interpreted in two ways:</p>



<ol class="wp-block-list">
<li>Its <strong>physical location</strong></li>
</ol>



<p class="wp-block-paragraph" id="6dbc">Data can be stored on computers and in systems that are under the organisation’s direct ownership or control through third parties that it uses. These might include cloud computing providers like Google, Amazon, or third-party analysis systems. It is completely fine to have data in many physical places (and ‘the cloud’ is exactly that).</p>



<p class="wp-block-paragraph" id="08b1">The impact of ‘many physical systems’ does create an operational burden and the organisation’s data teams should aim to minimise this burden by storing data in as few systems as possible. But they must maintain direct contractual control to ensure that the data is well managed and can be held to account (e.g. such as direct contracts with third parties).</p>



<p class="wp-block-paragraph" id="445c">2. Its&nbsp;<strong>legal</strong>&nbsp;<strong>location</strong></p>



<p class="wp-block-paragraph" id="d207">Regardless of physical location, the legal basis for data sharing must be clearly defined, contracted and enforced.</p>



<p class="wp-block-paragraph" id="7961">Organisations should aim to act as (and it&nbsp;<em>will</em>&nbsp;be in many jurisdictions) the primary data&nbsp;<strong>controller</strong>&nbsp;for all data that it collects. Making this clear is especially important when dealing with countries where rules around data are ‘early stage’. The concept of data ‘ownership’ is highly complex (especially with personal data) and a focus on ‘rights’ (rather than just ‘ethics’) can often help people focus on what’s important.</p>



<p class="wp-block-paragraph" id="69c9">The organisation can, and should, own the IP (intellectual property) on certain data it collects ( e.g. raw such as non-personal data that its teams have collected), derivative data (aggregate statistics), reports, analyses, insights, visualisations, etc. Owning the IP allows the organisation to explicitly license it to others if it wishes to (whether under Open Data or Shared Data licenses).</p>



<p class="wp-block-paragraph" id="4b79">The organisation will not ‘own’ personal data about individuals (e.g. EU citizens’ rights are covered by GDPR). Instead, it has a role as a data&nbsp;<strong>controller</strong>&nbsp;or as a data&nbsp;<strong>processor</strong>. Depending on its contracts it may have the right to do things with the data, including analysing it and sharing outputs with others.</p>



<p class="wp-block-paragraph" id="4a9a">If the organisation contracts a third party to do, for example, some data cleaning or analysis, it must (a) have the rights to do so; and, (b) do so under a contractual agreement that allows data to be processed by that third party. The organisation should not assign any ownership rights to any ‘primary’ data and nor should it assign rights to any derivate outputs (e.g. analysis) without assessing the risks or benefits of doing so. If it does, such rights must be codified in a contract.</p>



<p class="wp-block-paragraph" id="e726">It may be the case that sharing data with a third party can help create additional benefits (e.g. they can improve their analytics systems), in the same way using data from others can create additional benefits for the organisation.</p>



<p class="wp-block-paragraph" id="41b0">However, there are also new risks, such as using an organisation&#8217;s data to train machine-learning / artificial intelligence systems in ways that cannot be predicted. These risks include commercial, competitive, legal, liability, IP, ethical and moral hazards.</p>



<p class="wp-block-paragraph" id="b83b">The impact of ‘many legal contracts’ creates compound risks and the organisation must be crystal clear about its approach to data governance, including protections, licensing, processing and security. Creating common legal frameworks with multiple parties can take time, but they can also create cohesion, reducing risk and&nbsp;<em>unlocking permission</em>&nbsp;for innovation.</p>



<p class="wp-block-paragraph" id="f433">One way to think about this is to imagine ‘technical systems’ as consultants. It doesn’t matter where they are, we don’t give a consultant the right to do anything other than what we need them to do. It doesn’t stop them from learning and building on their own experience. As we move forward with new ‘ai’ systems, this takes on materially different dimensions and creates new types of risk and new types of opportunities.</p>



<p class="wp-block-paragraph" id="9f60">The purpose of this piece was to help non-technical people understand some of the basis of ‘<strong>where’ is data, who&nbsp;</strong>can use it, and for&nbsp;<strong>what</strong>&nbsp;purposes. I hope you found it useful and please leave comments if you have further questions or feedback.</p>



<p class="wp-block-paragraph" id="0893">One personal note: I find it far more useful to think about data&nbsp;<strong>rights</strong>&nbsp;(can&nbsp;<em>this</em>&nbsp;data be used for&nbsp;<em>that</em>&nbsp;purpose in&nbsp;<em>this</em>&nbsp;way) rather than data ‘ethics’ (which can mean very different things to different people).</p>



<p class="wp-block-paragraph">As we continue on our journey to a data-enabled world, we must ensure that&nbsp;<strong>data governance processes</strong>&nbsp;are in place to help everyone understand what they can and can’t do, and what to do when things go wrong.<a href="https://agentgav.medium.com/?source=post_page---byline--9a09a0f93804---------------------------------------"></a></p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">7556</post-id>	</item>
		<item>
		<title>Testing out this AI thing</title>
		<link>https://dgen.net/0/2023/03/24/testing-out-this-ai-thing/</link>
		
		<dc:creator><![CDATA[Gavin]]></dc:creator>
		<pubDate>Fri, 24 Mar 2023 17:58:08 +0000</pubDate>
				<category><![CDATA[business]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[Finance]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[science]]></category>
		<category><![CDATA[stuff]]></category>
		<guid isPermaLink="false">https://dgen.net/0/?p=6281</guid>

					<description><![CDATA[Here&#8217;s a basic algorithm for trading based on 1% value swings: Note: This is a basic algorithm, and there are many factors to consider when [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph"></p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<ol class="wp-block-list">
<li>create an algorithm for trading based on 1% value swings</li>
</ol>
</blockquote>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Here&#8217;s a basic algorithm for trading based on 1% value swings:</p>



<ol class="wp-block-list">
<li>Define your target security: Select a security that you wish to trade based on 1% value swings.</li>



<li>Set your trading parameters: Define the parameters for your trades, including the amount of capital you&#8217;re willing to invest, your desired profit margin, and your stop-loss limit.</li>



<li>Monitor the security&#8217;s value: Continuously monitor the value of your target security. You can use various tools such as trading software, financial news sources, or chart analysis to track its value.</li>



<li>Identify 1% value swings: When the security&#8217;s value changes by 1% in either direction, take note of it.</li>



<li>Buy or sell: If the value of the security has decreased by 1%, and you believe it will rebound, consider buying the security. Conversely, if the value of the security has increased by 1%, and you believe it may drop, consider selling the security.</li>



<li>Set stop-loss limit: To manage risk, set a stop-loss limit for each trade. This is the maximum amount of money you&#8217;re willing to lose if the trade doesn&#8217;t go in your favor.</li>



<li>Take profit: Set a profit target for each trade, which is the desired amount of profit you want to earn. When the security&#8217;s value reaches this target, close the trade and take your profit.</li>



<li>Repeat the process: Continue monitoring the security&#8217;s value, identifying 1% swings, and making trades as necessary.</li>
</ol>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Note: This is a basic algorithm, and there are many factors to consider when trading, such as market conditions, liquidity, volatility, and more. It&#8217;s important to do your research and fully understand the risks involved before implementing any trading strategy.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">2. write this is pseudocode</p>
</blockquote>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Sure, here&#8217;s the pseudocode for the trading algorithm based on 1% value swings:</p>



<figure class="wp-block-image size-large"><a href="https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35.png"><img decoding="async" width="1024" height="916" src="https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-1024x916.png" alt="" class="wp-image-6282" srcset="https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-1024x916.png 1024w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-300x268.png 300w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-768x687.png 768w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-830x743.png 830w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-230x206.png 230w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-350x313.png 350w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35-480x429.png 480w, https://dgen.net/0/wp-content/uploads/2023/03/Screenshot-2023-03-24-at-17.53.35.png 1482w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Note that this is a basic pseudocode and it does not include error handling or other advanced features. Additionally, some variables and functions may need to be defined and implemented separately.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">3. write this in python</p>
</blockquote>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Sure, here&#8217;s an example implementation of the trading algorithm based on 1% value swings in Python:</p>



<pre class="wp-block-preformatted has-white-color has-black-background-color has-text-color has-background">target_security = "AAPL"  # define the target security

# define the trading parameters
capital = 1000
profit_margin = 1.01  # 1% profit margin
stop_loss = 0.99  # 1% stop-loss limit

while True:
    current_value = get_current_value(target_security)  # get the current value of the target security
    if current_value >= profit_margin:
        sell(target_security)  # sell the security if it has increased by 1%
    elif current_value &lt;= stop_loss:
        buy(target_security)  # buy the security if it has decreased by 1%
    else:
        continue  # otherwise, continue monitoring the value

    # set stop-loss limit and profit target
    stop_loss_value = current_value * stop_loss
    profit_target_value = current_value * profit_margin

    while True:
        updated_value = get_current_value(target_security)  # get the updated value of the target security
        if updated_value &lt;= stop_loss_value:
            sell(target_security)  # sell the security if it hits the stop-loss limit
            break
        elif updated_value >= profit_target_value:
            sell(target_security)  # sell the security if it hits the profit target
            break
        else:
            continue  # otherwise, continue monitoring the value
</pre>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Note that this is just an example implementation and may need to be adapted to your specific trading platform or strategy. Also, the <code>get_current_value</code>, <code>buy</code>, and <code>sell</code> functions are not defined here and need to be implemented separately based on the API or service you&#8217;re using.</p>



<p class="has-text-align-center wp-block-paragraph"><em><strong>And now for some fun</strong></em></p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="wp-block-paragraph">write this for a quantum computer</p>
</blockquote>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">While quantum computers have the potential to solve certain financial problems more efficiently than classical computers, it&#8217;s currently unclear how exactly they could be used for trading based on 1% value swings. As quantum computing is still in its early stages of development, there are few, if any, quantum trading algorithms that have been developed and tested at scale.</p>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">However, one possible approach to leveraging quantum computing for trading is by using quantum machine learning algorithms to analyze financial data and identify patterns that can be used to make trading decisions. For example, one could use quantum annealing to optimize portfolio selection and risk management, or quantum algorithms to perform efficient optimization of trading strategies.</p>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Here&#8217;s an example of how one could use the Qiskit framework in Python to implement a simple quantum machine learning algorithm for financial prediction:</p>



<pre class="wp-block-preformatted has-white-color has-black-background-color has-text-color has-background">import numpy as np
from qiskit import Aer
from qiskit.circuit.library import ZZFeatureMap
from qiskit.aqua.algorithms import VQC
from qiskit.aqua.components.optimizers import COBYLA

# Define the target security and trading parameters
target_security = "AAPL"
capital = 1000
profit_margin = 1.01
stop_loss = 0.99

# Define the quantum feature map and backend
feature_map = ZZFeatureMap(feature_dimension=2)
backend = Aer.get_backend('qasm_simulator')

# Define the VQC classifier and optimizer
classifier = VQC(feature_map, None, None)
optimizer = COBYLA()

# Train the classifier on historical financial data
data = np.array([[0.5, 0.1], [0.1, 0.9], [0.2, 0.8], [0.3, 0.7], [0.4, 0.6]])
labels = np.array([0, 1, 1, 0, 0])
classifier.train(data, labels)

# Use the classifier to make trading decisions
while True:
    current_data = np.array([[get_current_price(target_security), get_current_volume(target_security)]])
    predicted_label = classifier.predict(current_data)[0]
    if predicted_label == 0:
        buy(target_security)
    elif predicted_label == 1:
        sell(target_security)
    else:
        continue

    # Set the stop-loss limit and profit target
    stop_loss_value = get_current_price(target_security) * stop_loss
    profit_target_value = get_current_price(target_security) * profit_margin

    while True:
        updated_price = get_current_price(target_security)
        if updated_price &lt;= stop_loss_value:
            sell(target_security)
            break
        elif updated_price >= profit_target_value:
            sell(target_security)
            break
        else:
            continue
</pre>



<p class="has-background wp-block-paragraph" style="background-color:#eeeeee">Again, note that this is just a simple example of how one could use quantum machine learning for trading, and many details would need to be filled in depending on the specific application and data available.</p>



<p class="wp-block-paragraph">So, there we have it. I can now learn how to write code for a quantum computer that might have some bearing on financial insights, with zero knowledge.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">6281</post-id>	</item>
	</channel>
</rss>
