Integrated Data on Kailas Venkitasubramanian

Changing CRDT operations under a Cloud

Fri, 09 Jun 2023 00:00:00 +0000

The promise and peril of a large contract

Much of the previous challenges in managing the technical operations at the data trust stemmed from a lack of understanding of the scope and extent of effort for a given piece of work and having no barometer to measure productivity (or the lack of it). This meant that everyone knew that a given piece of work took 1 month to complete, everyone agreed that this delay was not acceptable,but no one really could pinpoint where the bottlenecks were and why they existed.

Plunging into the Data Trust black box, and Deep Cleaning the System

Sat, 20 May 2023 00:00:00 +0000

Diving into the world of administrative data and CRDT

Administrative data is messy is not much of an adage as much as it is a reality. When I took reins of managing the data infrastructure and analytical operations of Institute for Social Capital or ISC (now called the Charlotte Regional Data Trust) in the middle of 2021, messiness extended beyond data. The dysfunction was deep in how data was collected and organized, the way data operations and analyses were conducted, how information was collected from stakeholders, and how data was disseminated.

CRDT Anonymization and Privacy Project

Mon, 06 Jun 2022 00:00:00 +0000

Summary

Objective(s) and Scope

The project involves the development and implementation of protocols and best practices in privacy for data dissemination, including statistical disclosure control procedures of the integrated data system hosted by CRDT. This includes creating guidelines for data collection, storage, and dissemination, as well as implementing robust technical measures to prevent unauthorized access and disclosure of sensitive information.

The project will start with a comprehensive review of current privacy practices and identification of areas that need improvement. Based on this review, a set of protocols and best practices will be developed and incorporated into the organization’s data management processes. This will include the implementation of statistical disclosure control procedures to protect sensitive information. Training sessions will be conducted to educate employees on the new privacy protocols and best practices.

CRDT Technical Operations Manual

Mon, 04 Apr 2022 00:00:00 +0000

Summary

Objective(s) and Scope

The goal of this project is to create a comprehensive technical operations manual that documents all operational processes of the Charlotte Regional Data Trust The manual will serve as a single point of reference and provide clear, up-to-date information on all operational procedures.

The manual will be created using Rmarkdown, a tool that allows for the creation of rich, interactive documents. The manual will be hosted as a website that can be easily updated and maintained by team members.

CRDT Data Integration Project

Tue, 05 Oct 2021 00:00:00 +0000

Summary

Background

This is part of the CRDT Data Infrastructure project

Objective(s) and Scope

This project aims to develop improved data integration mechanisms for CRDT’s data assets, ensuring accurate and consistent data integration. This involves the development of an entity resolution framework and the implementation of probabilistic record linkage techniques to enhance the CRDT’s data integration processes.

The project will start with a comprehensive review of CRDT’s current data integration mechanisms and identification of areas for improvement. Based on this review, an entity resolution framework will be developed to ensure accurate identification of entities across different data sources. Probabilistic record linkage techniques will be implemented to link records from different data sources and provide a unified view of the data.