We live in a world awash with data, but it's not just about having data. It's what you do with it that counts. You're out there, data warriors, fighting the good fight. You've got insights that could ...

DataHub Cloud Launch on Open Data Day: Build elegant data-driven sites with markdown & deploy in seconds

Hey everyone! Remember when we announced the launch of MarkdownDB not too long ago? It was pretty exciting stuff, and if you missed it, you can catch up on all the details in our previous post right h...

Unveiling MarkdownDB's Latest Features: Export to JSON, task extraction, and computed fields

When it comes to data, the energy industry is similar to any other: data can provide clarity and insight in ways that were unachievable only a couple of decades ago. There is no limit to the metaphori...

The Impact of Data on the Energy Industry

In our last article, we explored the Open Spending revamp. Now, let's dive into the tech stack that makes it tick. We'll unpack how PortalJS, Cloudflare R2, Frictionless Data Packages, and Octokit com...

The OpenSpending Revamp: Behind the Scenes

Hello, dear readers!We're excited to announce the official launch of MarkdownDB, an open-source library to transform markdown content into sql-queryable data. Get a rich SQL API to your markdown files...

Announcing MarkdownDB: an open source tool to create an SQL API to your markdown files! 🚀

Hey everyone! 👋 Summer has been in full swing, and while I've managed to catch some vacation vibes, I've also been deep into code. I'm super excited to share some of the latest updates and features w...

What We Shipped in Jul-Aug 2023

Are you keen on building rich and interactive data portals? Do you find value in the power and flexibility of JavaScript, Nextjs, and React? In that case, allow us to introduce you to PortalJS, a stat...

Enhancing Geospatial Data Visualization with PortalJS

Last Friday, a spirit of creativity and collaboration filled the virtual halls of Datopian as we embarked on an interesting journey: our internal PortalJS Hackathon. This event set the stage for our t...

An Inside Look at Datopian's PortalJS Internal Hackathon #1!

We at the PortalJS team are longtime fans of the FiveThirtyEight website. We consider the authors one of the best in their business when it comes to data journalism and data visualization. Having said...

Data.fivethirtyeight.com reimagined with PortalJS

At Datopian, we've long been passionate about the potential of open data to foster transparency, informed decision-making, and innovation. We don’t just recognize the power and the potential of open d...

The Open Spending Revamp

Greetings from the vibrant world of Datopian! We are thrilled to announce an exciting event that's currently unfolding in our digital workspace. Our dedicated team is engaged in an internal hackathon ...

Internal PortalJS Hackathon at Datopian: MasterMinds at work!

Today we're kicking off a 3-week training program with participants from the Gulf Region. The training program is designed for government agencies that would like to immerse themselves in the world of...

Open Data & CKAN Training Program kicking off today

We'd like to congratulate Muhammad Ismail Shahzad and Shubham Mahajan for getting their CKAD (Certified Kubernetes Application Developer) and CKA (Certified Kubernetes Administrator) certifications!We...

Datopians of the month: Ismail & Shubham got their Kubernetes certifications

In this interview Rufus Pollock, president at Datopian, discusses the importance of Open Data, the fact that information alone is not enough to ensure wise decision-making and the potential of Renumer...

Will the revolution be open?

Great news! European Commission has adopted the proposal of the Interoperable Europe Act!The term 'interoperability,' may sound a bit complicated, but it is really all about being able to work togethe...

Great news: European Commission has adopted the proposal of the Interoperable Europe Act!

It's Friday! Many people are waiting for the weekend while we are having an Internal Friday Hackathon! The main goal? To ship out a functioning decoupled frontend after focussed work from our develope...

Internal Friday Hackathon at Datopian: MasterMinds at work!

It's the World Environment Day - the United Nations day for encouraging worldwide awareness and action to protect our environment.A lot has been said on the value of data and its correlation to tackli...

Datopian, Open Data and the Environment

A crucial tool for any organization, data portals perform a range of functions, from providing an easily-searchable catalog of your data to enabling data visualizations and enhancement. This article i...

A Brief Introduction to Data Portals

Data has become increasingly intertwined with our daily lives as more companies collect, analyze, and utilize it—and its use is growing exponentially. Data is everywhere. IoT is opening up new possibi...

On the Value of Data

The Frictionless specifications are helping with simplifying data validation for applications in production at the European Union.Do you remember Costas Simatos? He introduced the Frictionless Data co...

A Short Case Study Involving Table Schema Frictionless Specs at the European Union

Currently, CKAN implicitly has four distinct components:Because the DB is usually a separate service we might not strictly consider if part of CKAN as a project (hence the dashed line in the diagram)....

A more decoupled CKAN: making CKAN easier to customize, maintain and extend

After years of work fine tuning our products and developing and expanding our services, we thought it’s time our website reflected how far we’ve come. Here’s a quick overview of some of what’s new.Eve...

Check out our new website!

Effective data management is crucial for public administrations, who collect large amounts of diverse data on a daily basis. They differ from other data-collecting organizations in the sense that the ...

Leveraging CKAN for publishing open data in Germany

In case you missed it, here’s a transcript of Rufus’ insights during the closing debate of the first digital edition of the EU’s annual semantic interoperability conference (SEMIC). Alongside fellow p...

“Is it a bird, is it a plane?” Here’s what Datopian founder & CTO, Rufus Pollock, had to say about data quality at SEMIC 2020

Whether it’s fighting climate change or finding the nearest bus stop, creating insight requires data. The higher the quality of that data, the greater and more reliable the insight. What does good dat...

How to climb the Data Quality Pyramid

He’s speaking again! Here’s a brief overview of why you’ll want to tune in to this year’s edition of SEMIC next week to hear Rufus’ insights on interoperability.



On 15th October 2020, policymakers,...

Datopian founder and CTO, Rufus Pollock, to speak at the EU’s annual semantic interoperability conference (SEMIC)

Traveling Datopians is a series of photo essays and journals documenting the adventures of Datopian colleagues, many of whom have used the freedom that comes with our remote-first culture to take thei...

Traveling Datopians: Patricio in Europe

What do the Victorian physician John Snow, a Danish toilet-locating app, and our president, Rufus, have in common? The punchline: they were all inspired by open data. This article explores a term stil...

What is Open Data?

July 16, 2020 by Annabel van DaalenDatopian are proud to announce a new partnership with publicplan GmbH, a German IT company specialising in open-source software solutions and IT consulting for publi...

Datopian partner with publicplan GmbH to boost CKAN adoption in Germany

This article is a summary of an interview between Rufus Pollock and Richard Pietro for the podcast series Stories from the Open Gov. Rufus tells the story of the Open Knowledge Foundation’s journey, f...

Podcast: Open Knowledge Foundation founder (and Datopian President!) Rufus Pollock shares the the organisation's backstory

OpenSpending is one of the longest-running projects both at Open Knowledge Foundation and within the open data ecosystem in its entirety. Starting life in 2009 as Where Does my Money Go?, OpenSpending...

OpenSpending stewardship moving to Datopian

The following is a transcript of a Q\&A with Datopian Founder and President Rufus Pollock about the vision for Datopian over the long-term.We think there is a huge opportunity around data management i...

Datopian Vision Q&A: the need for Data Management, DataOS, Open Source and more

June 22, 2020 by Annabel van DaalenThree months on from Open Data Day 2020 and the reports are out: from budget data in Indonesia and Uganda to renewable energy data in Germany, Datopian’s mini-grants...

Open Data Day 2020 - Mini-Grant Outcomes

Last month, we announced the launch of a new CKAN feature developed by Datopian that allows users to subscribe to datasets. This is an opt-in feature that sends users an email notification when a data...

Subscribe to Datasets: New CKAN Feature Explained

In a previous article, we drew an analogy between CMS (that’s ‘content management system’) and DMS (‘data management system’) to show how the two software share a similar structure. Now, in this follo...

Datopian Presents: Headless DMS

You’ve heard of a content management system (CMS), but have you heard of a data management system (DMS)? In this article, we show that the two aren’t all that different. Just as many companies turn in...

As CMS is to Content, DMS is to Data

As Open Data Northern Ireland (NI) roll out their new strategy focusing on more open data publications in the civil service and better community outcomes, the future for Open Government in NI looks br...

Open Data Northern Ireland looks to an Open Government future with Datopian

With a long history in statistical software, the SIS-CC, under the OECD secretariat, recently launched the .Stat Suite in open source. To meet the challenges in making this transition, they turned to ...

OECD’s SIS-CC .Stat Suite goes Open Source with Datopian

CKAN and Datopian DMS (which is built on CKAN) are an integrated data management solution for managing metadata and data. It provides non-specialist users with an easy-to-use interface, while deep ext...

Understanding access permissioning with CKAN and Datopian DMS

As the Scottish Cities Alliance invest in new technologies to create ‘Scotland’s eighth city - the smart city’ to accelerate and transform service delivery, Datopian’s open source, collaborative and c...

Scottish Cities Alliance progressing towards Smart Cities with Datopian

As open data continues to play a pivotal role in supporting the response to the covid-19 crisis, Datopian spoke with Open Data NZ’s, Paul Stone, on the extraordinary work they’re doing in supporting o...

How Open Data can help build Resilient Communities

We are releasing a new service where people can get notified when datasets change.

We believe we can build better products through collaboration. Following past examples, we are now open-sourcing a n...

Release: Subscribe to CKAN datasets

Once upon a time, more and more organizations such as enterprises, governments, and NGOs had more and more data from more and more sources, both internal and external. They knew (or felt) that it must...

Once upon a time in data land … more and more organizations had more and more data

The call for action to respond to the coronavirus COVID-19 pandemic has led many public groups and private organisations on a quest to find new approaches or solutions in dealing with this urgent prob...

So you want to join a Covid-19 Data Hackathon

Energinet is preparing for a new future of renewable energy using integrated open energy data on a CKAN platform in collaboration with Datopian.Photo by Adrien Hobbs on UnsplashAn independent public e...

Energinet sees a Green Energy Future alongside Datopian

Our colleagues at the Open Knowledge Foundation announced the Joint Stewardship of Frictionless Data in December 2019. Some of that announcement post is below, and I also wanted to give some more cont...

Announcing Frictionless Data Joint Stewardship

In this article, we share our tips (and traps to avoid!) on working seamlessly in a remote-working setup.Team member exploring trekking as a physical activityWhile many governments and organisations a...

Tips on Remote Working: How we do it at Datopian!

Hi there, My name is Gift Egwuenu and I’m super excited to share I joined Datopian as a Frontend Developer and Developer Evangelist! 🎉Frictionless Data is an open-source toolkit that brings simplicit...

Joining the Frictionless Data Team

We know many people and organizations around the world are experiencing challenges due to the COVID-19 pandemic. We wanted to reach out to our partners and clients to assure you of Datopian’s work cap...

Datopian and COVID-19

https://rufuspollock.com/2015/12/06/ckan-technical-roadmap-thoughts-dec-2015/Here is an overview of the different feature clusters of a full portal:Source: https://tech.datopian.com/Data Portals are r...

CKAN: Some Ideas for the Road Ahead

I was recently faced with the problem of finding an apartment in Berlin. As you might have heard, this task is not getting easier over time. For foreigners who don’t speak German fluently especially, ...

Running a scraping platform at Google Cloud for as little as US$ 0.05/month

2019 has been a great year at Datopian, and we wanted to take this opportunity to share with our clients, partners, and the wider community some reflections on the year past, and thoughts on 2020.Afte...

Datopian: 2019 in review, and looking toward 2020

December 13, 2019 by Paul Walsh

Next year marks the 10th anniversary of Open Data Day! Open Data Day is the annual event where we gather to reach out to new people and build new solutions to issues i...

Getting ready for Open Data Day 2020 on Saturday 7th March

DataCity is a project aimed at creating a single repository of all municipal data in Israel. In my presentation at this years’ PyCon Israel, I’ll talk about the project and the Python toolset we’ve bu...

Making our Municipalities more Transparent using Python

Effective today, we are renaming Viderum to Datopian. All viderum.com related services (including email) will continue to work as normal, and we will roll out the rebrand across all our web properties...

Viderum is renaming to Datopian

Hello. I’m Paul Walsh and I am the new CEO of Viderum. I moved to Viderum after 5 years at Open Knowledge International, where I have been on the Senior Management Team as Chief Product Officer and in...

Viderum in 2019

Once upon a time, more and more organizations (enterprises, governments, NGOs) had more and more data from more and more sources (internal and external).They knew/felt that it must be valuable if only...

Once Upon a Time in Data Land

Open Knowledge International and Viderum are delighted to announce that Rufus Pollock is joining Viderum as President and CEO. Rufus is a pioneer and leader in the open data community, founder of Open...

Announcing Rufus Pollock is Joining Viderum

There are a number of note-taking applications in the market, but if you are a power user, it can be hard to find exactly the “right solution”. Depending on your needs, you may want to use several dif...

Note Taking Software

Finding open source software that creates both beautiful and customised contact forms for your website is tricky. Software that allows you to store responses, inform you of new contact requests, enabl...

Contact form providers

A revolutionary new online portal, which gives open access to Denmark’s energy data, is set to spark innovation in smart, data-led solutions for energy efficiency. The Energy Data Service, being launc...

New open energy data portal set to spark innovation in energy efficiency solutions

We are happy to announce that CKAN is now available under the G-Cloud 9 framework. This special program creating a digital marketplace for cloud-based solutions was created by the UK government to i...

CKAN now available on G-Cloud 9

Who would have thought? When I wrote “You think open source is boring? Think again” in 2004, I never could have dreamt that it would still be relevant twelve years later. Open source is not only alive...

Beyond theory: does open source really matter?

Open data service provider Viderum is working with Energinet.dk, the gas and electricity operator in Denmark, to share near real-time access to Danish energy data. Using CKAN, an open-source platform ...

Danish Energinet will use CKAN to launch Energy DataStore - a free and open portal for sharing energy data

November 10, 2016 by Frederic Dubois- The king has decided! 5,000 municipalities are going open data in early 2017. Guess where…
\- Hmmm.
\- Let me give you a hint: it's in Europe…
\- Hmmm, a king in ...

Open data: think local, act local

Back in 2006, two journalists from The Guardian wrote the article Give us back our crown jewels, in which they pleaded for the UK government to collect the best data possible and to make it freely ava...

Open data, a lifeline for journalism?

Northern Ireland, with an estimated population of just under 2 million, hopped onto the open data bandwagon in 2015. Journalist Frédéric Dubois talked to OpenDataNI’s Cormac McConaghy to find out what...

Northern Ireland: One year of open data “by default”?

Opening data is one thing. Many open knowledge activists out there will cheer when seeing yet another city making some of its public interest information available to the rest of us. There is also rea...

Escaping ‘data blindness’ with the help of data visualisation

We are now in the 11th week of our Official Inquiries project. This month, we managed to introduce a simple search feature to the website, that will allow visitors to the site to search the text inqui...

September Update!

We are now 8 weeks into the Official Inquiries project. One of the most time-consuming challenges the project faces is that of turning PDF files of inquiries into clean, readable text. Converting a PD...

Testing PDF Extraction Tools

At Viderum, we want to make open data simple. And we want you to get the most out of your CKAN portal. So, today, we’re starting a series of video tutorials showing how to do different tasks within CK...

New CKAN video tutorial series

Working in the fast-growing area of open data, we build open source tools to drive transparency, accountability and re-use. Based on CKAN, we‘ve built the the official national data portals from the U...

Senior Python Web Developer wanted

In our preceding case study, Empowering the Energy Sector: Utilizing CKAN and PortalJS to Build a Transparency and Innovation-Centric Data Portal for Scottish Southern Electricity Networks, we explor...

A Technical Case Study: Enhancing Energy Efficiency: Leveraging Advanced Data Solutions for SSEN's Grid Management

The city of Santa Monica was looking for cost efficiency and improved user experience. Also, the city was not utilizing all the features offered by Socrata. The city was looking for an alternative th...

From Socrata to CKAN: A Seamless Data Portal Migration for the City of Santa Monica

Scottish Southern Electricity Networks (SSEN) is a leading Distribution Network Operator (DNO), powering over 3.8 million homes and businesses across central southern England and northern Scotland. A...

Empowering the Energy Sector: Utilizing CKAN and PortalJS to Build a Transparency and Innovation-Centric Data Portal for Scottish Southern Electricity Networks

The Global Initiative for Fiscal Transparency (GIFT) serves as a cornerstone in the global governance landscape, providing a dynamic platform for fostering communication among key actors such as gove...

Upgrading OpenSpending: How GIFT and Datopian Elevated Open Government Data Solutions for Fiscal Transparency

In a strategic and ambitious step toward enhancing civic transparency and fostering collaboration, Birmingham City Council, the administrative entity overseeing the Birmingham City Observatory, aspir...

Birmingham's Open Data Revamp: Civic Transparency through CKAN and PortalJS

With open data increasingly becoming the standard instead of the exception, there are many innovations in the works to provide data to the public in easily accessible ways. In some cases, policies ha...

Mastering Big Data Hurdles through Data Engineering: A Transformational Journey to Elevated Data Analytics

Open Data DK is a joint effort between a number of Danish municipalities and other public authorities. Their primary goal is to provide an easy and accessible open data platform for public data that d...

Streamlining Data Accessibility in Denmark: How Open Data DK Leveraged CKAN for a Secure, Multilingual Portal

The Federal Competitiveness and Statistics Centre (FCSC) is a government center affiliated with the Ministry of Cabinet Affairs in the United Arab Emirates (UAE). FCSC is actively involved in raising...

Revolutionizing Open Data in the United Arab Emirates: The Creation of a New Open Data Portal with PortalJS and CKAN

See in HackMD.Vital Strategies is an international nonprofit that assists governments by designing easily scalable solutions to address the many challenges found in—and around—public health. These pu...

An Open Data Platform for Vital Strategies - a global public health organization

The United States Department of Education focuses on creating and assisting in executing policies for—along with administrating and coordinating federal assistance to—education. Part of fulfilling th...

An Open Data Platform for the U.S. Department of Education

As data is becoming the world's most valuable commodity and leads to outputs in the scale of zettabytes (1 zettabyte can store roughly 10 billion 4K movies of 100 gigabytes each!), there is undoubted...

Helping a sustainable data-driven business derive meaning from information

The Client is a fortune 500 company, one of the largest pharmaceutical corporations in the world, with a highly specialized Gene Research and Therapy division in Silicon Valley, California. As a high...

A novel tool developed for a Fortune 500 Pharma and Biotechnology Corporation

The NHS Business Services Authority (NHSBSA) is an arm’s length body of the Department of Health and Social CareThe NHS Business Services Authority is an Arm’s Length Body of the Department of Health...

An Open Data Portal for the NHS Business Services Authority

In recent times, owing to climate change and other factors, water resources around the world are changing and deteriorating. It is therefore imperative to judiciously manage this finite resource that...

New Mexico Water Data Initiative

The Organisation for Economic Co-operation and Development (OECD) is an international organisation that provides a data hub for official statistics, called the .Stat Suite. The software is co-develop...

Organization for Economic Co-operation and Development

This case study is the product of an interview with Iain Fleming (Open Data Strategy Lead, Open Data NI) and Cormac McConaghy (Portal Manager, Open Data NI).The Open Data Northern Ireland (NI) portal ...

Open Data Northern Ireland

This interview is the product of an interview with Doug Young (Cluster Coordinator, Scottish Cities Alliance).
The Scottish Cities Alliance is a collaboration between Scotland’s seven cities - Aberdee...

Scottish Cities Alliance: Case Study of collaboration

Energinet is an independent public enterprise owned by the Danish Ministry of Climate, Energy and Utilities. It is on a social mission to change the energy system so that citizens and businesses only...

Energinet: towards a new future of renewable energy

The Open Knowledge Foundation (OKF) is a non-profit working towards a fair, free and open future. Datopian was spun out of OKF and the two organizations collaborate together on global client projects ...

Blog

A novel tool developed for a Fortune 500 Pharma and Biotechnology Corporation

An Open Data Portal for the NHS Business Services Authority

New Mexico Water Data Initiative