To the Curators, Go the Spoils: The Rising Power in Graph-Enhanced AI Models

One of the inherent weaknesses of Language Learning Models (LLMs) like GPT-4 is their struggle with maintaining context or conducting complex reasoning over an extended interaction. Increasingly vectors are being employed as a short-term memory solution, serving as quick look-up tables to bridge this gap. However, vectors fall short in capturing relational complexities between data points. With a nod to symbolic AI, there is increasing relevance for graphs – data structures that consist of nodes connected by edges, designed to model intricate relationships and hierarchies. 

In the context of powerful AI models, the knowledge captured by graphs represents facts and relationships, but also societal memory; shaping how machines process and interact with human culture, ethics, and values. 

The simplest approach is to use static (i.e. prepopulated) structures. These graphs offer relational context that vectors can’t but don’t shift to match new contexts or adapt and learn. As the technology matures, the complexity of the data we wish to represent increases and our desire for a generalised neuro-symbolic approach grows, we might see a push for dynamic, hybrid graphs that evolve and learn from ongoing interactions to form new representations of accepted knowledge.

This shift from vectors to static and dynamic graphs is not just a technological leap; it’s also a shift in power dynamics, creating new, pivotal roles of curators and administrators of the stored knowledge graph.

 

The Curators

The initial curators aren’t just data input specialists; they are gatekeepers of an AI’s foundational knowledge. Their role might involve both manual curation – hand-picking and validating information – and overseeing automated processes, which might involve algorithms that gather vast amounts of data at scale. Both come with their unique challenges. Manual curation ensures a level of accuracy and intentionality, but is time-consuming and might inadvertently introduce human biases. Automation, on the other hand, can efficiently populate the graph with vast datasets but might also bring in noise, errors, or unanticipated biases from the sources it pulls.

The power that these curators wield is immense. A seemingly minor decision on which data to include or exclude, or how to structure relationships within the graph, can significantly influence the AI’s decisions, behaviors, and even its understanding of societal norms and values. Their choices set the initial trajectory for the AI, determining its capabilities and limitations. This initial framework becomes the lens through which the AI views and interprets the world, and reshaping or correcting it later can be a daunting task.

 

The administrators 

While initial curators set the foundation, the administrators of dynamic updates guide the AI’s growth and evolution. They are the gardeners tending to a rapidly growing tree, pruning here, nurturing there, ensuring balanced growth. They oversee the continuous feedback and learning cycles that allow the AI to adapt to new information and changing environments. Their tools include automated learning algorithms, but importantly they decide what data the AI is exposed to, how it should be integrated into the existing graph, and when anomalies or potential biases should be addressed.

Their power lies in the subtleties of these decisions. For example, how do they prioritize new data? Do they allow the AI to adapt rapidly to trending topics or maintain a more stable, longer-term perspective? How do they handle conflicting information or potential misinformation? And most importantly, how do they ensure the AI’s alignment with desired ethical standards and societal values while it continuously evolves?

Mismanagement or pursuit of innovation above investment in safety at this stage can lead to the AI drifting from its intended purpose or amplifying existing biases in its knowledge base. Further, there’s a risk of the AI developing interpretations or behaviors that are out of sync with human values and societal norms.

 

A Call for National Involvement

There’s an urgent need for countries to take an active role in this evolution. National governments must ensure that the unique knowledge and culture of their diverse societies are adequately represented and have a voice. Without this active participation, there’s a real risk of erasing the richness of our distinct societies as the monochrome reflecting only dominant cultures or viewpoints becomes the oracle on which the next generations of AI are built.

By proactively understanding and representing our cultures, nations can shape the evolution of these technologies in a way that respects and preserves their unique heritage. It’s not just about avoiding biases; but ensuring the inclusion in the foundational models of the future the specific domains of traditional knowledge, localised ethical considerations, and societal norms that make each culture unique. The bedrock of AI understanding must preserve the richness of humanity.

 

The Way Forward

The evolution towards using pre-populated and dynamically updated graphs in AI architectures is poised to give unprecedented power to the roles of the curators and administrators. As this technology becomes an integral part of our lives, these roles won’t just be about technical proficiency; they’ll be positions of social, ethical, and even political significance.

To ensure we’re heading in a direction that respects and embraces the pluralistic world we live in, it’s critical to have a diversified, multidisciplinary approach to curation and administration. From ethicists and social scientists to technologists and policymakers, it’s going to take a village to raise this new breed of AI responsibly.

To the curators and administrators of tomorrow, the spoils are immense, but so are the responsibilities. And to our national governments, the call is clear: take an active role in shaping this future, or risk being shaped by it

Terms and Conditions: Emerging Technology Quick Scan Assessment

This assessment tool and all associated documentation has been prepared Maior Natu Pty Ltd ACN 649 020 039 as trustee for Sancus Trust ABN 46 507 741 242 trading as TechInnocens (TechInnocens) and is provided to you on the following conditions:

 

  • this tool and documentation is strictly confidential and is solely for your own use and that of your professional advisers. It must not be provided to any other party without the prior written consent of TechInnocens, which may be withheld in the absolute discretion of TechInnocens;
  • the content in this tool and documentation does not constitute advice (including tax, legal or ethical advice);
  • you should consider the appropriateness of the information contained in this tool and documentation and make your own decisions based on your individual and/or corporate objectives and needs. You should obtain independent legal, financial and/or other professional advice, as appropriate, relevant to your individual and/or corporate needs before making a decision based on this information.
  • you acknowledge that TechInnocens is the owner of the intellectual property owned or used in connection with this tool and documentation, including without limitation: any patent, know-how, trade mark, service mark, copyright, invention, design, trade secret or confidential information, and any other intellectual property or rights whether registered or not used in connection with or forming part of any business of TechInnocens (Intellectual Property);
  • you hereby disclaim any interest (implied or otherwise) that you may have or may be assumed to have in the Intellectual Property;
  • TechInnocens has the right to deal with the Intellectual Property in any way whatsoever, including to assign or licence the Intellectual Property to any third party; and
  • you agree not make any claim against TechInnocens in relation to the Intellectual Property.

 

Statements in this tool and documentation are made only as of the date of usage of the tool unless otherwise stated. TechInnocens is not responsible for providing updated information to you. Neither TechInnocens nor its officers make any representation or warranty as to, or take responsibility for, the accuracy, reliability or completeness of the information contained in this tool and documentation. Nothing contained in this tool and documentation , nor any other related information made available to you is, or shall be relied upon as, a promise, representation, warranty or guarantee, whether as to the past, present or the future. 

 

To the maximum extent permitted by law, TechInnocens and its officers disclaim all liability that may otherwise arise from reliance upon this tool and documentation or due to any information contained in this tool and documentation being inaccurate or due to information being omitted from this tool and documentation , whether by way of negligence or otherwise.  Neither TechInnocens, its officers nor any other person guarantees the performance of any proposed information referred to in this tool and documentation . You must accept sole responsibility associated with the use and/or reliance of the material in this tool and documentation , irrespective of the purpose for which such use or results are applied.

 

The copyright in all information contained in this tool and documentation is owned by or licensed to TechInnocens.  Except as expressly permitted, no information may be copied, reproduced, transmitted or re-distributed. All rights reserved.