Navigating the polarising effect of GenAI: Ensuring access to knowledge in law firms

This post explores how generative AI (GenAI) is reshaping the legal field and the critical role knowledge and information professionals play in this transformation. The rapid advancement of artificial intelligence (AI) and its integration into various industries has elicited a wide range of reactions. 

Our approach to information management, retrieval, and dissemination is changing permanently

For those in the information and knowledge sector, especially within law firms, this technological evolution presents both opportunities and challenges. With tools like ChatGPT utilising an unprecedented breadth of knowledge, it’s clear that our approach to information management, retrieval, and dissemination is changing permanently. 

As Daniel Hoadley recently stated at the BIALL conference, “…law firm AI is going to rely heavily on knowledge management and this reliance is going to increase; AI needs KM.” 

This is music to our ears! Just as the emergence of Google changed the way we search, GenAI will impact how we make sense of all this knowledge. But to stay relevant, library and information professionals must be involved in the testing and development process. 

Do we really understand what is going on with GenAI tech?

GenAI, represented by models like ChatGPT, is fundamentally a sophisticated predictive text system. It generates sentences by predicting the most logical continuation based on patterns in extensive datasets. Despite its apparent intelligence, it is crucial to understand that these models do not truly comprehend the language they produce.  

This duality – being surprisingly intelligent yet capable of significant errors – highlights the complexity of GenAI. One of the striking revelations from recent discussions is that even experts do not fully understand the internal workings of large language models (LLMs). This knowledge barrier poses a significant challenge, especially for non-specialists who must navigate these limitations when implementing AI solutions in legal contexts. 

We must be aware of the following when we are looking at the limitations of AI solutions such as ChatGPT or CoPilot etc: 

  • The training data used might be subject to a cutoff date 
  • The training data might be of questionable quality – think legally, ethically, accuracy 
  • There are occasional errors or hallucinations in the results 
  • If it is an out of the box solution, it will need to be trained if you want the best results 

As Robin Chesterman summarised in a previous BIALL conference session, “large language models are good at saying what an answer should sound like, which is different from what an answer should be”. If we keep this in mind, we can use the technology to our advantage and highlight the benefits to our end-users. 

Can we keep up with the rapid pace of tech? What are the downsides?

The pace of GenAI development is staggering. Since the release of OpenAI’s GPT-1 six years ago, advancements have accelerated, with notable iterations such as GPT-3.5 in November 2022, GPT-4 in March 2023, and subsequent versions leading up to GPT4o in May 2024. 

Each iteration brings improvements in speed, cost-efficiency, and data processing capabilities, enabling legal LLMs to analyse extensive legal texts efficiently. Understanding the limitations mentioned above is essential for leveraging GenAI effectively while mitigating risks.  

With that in mind, Peter Winders banned GenAI at his firm for research and writing, and he explains,  

This invention may be useful for some purposes—those where the user immediately knows whether the output is accurate, or where the accuracy isn’t important to the user, and where zero understanding or analysis of sophisticated concepts is required. But it simply can’t be used to produce competent legal product intended to aid a client or assist a court in the important work of fairly deciding disputes and developing the law. 

However, I feel that all businesses should be open to new developments. They must investigate the possibilities. This curiosity is being demonstrated by innovative law firms taking the lead in the legal GenAI world. 

chat AI illustration

New ways to search: Have you already stopped using Google in favour of ChatGPT?

The advent of GenAI has introduced new paradigms in information retrieval. Traditional search engines like Google are being complemented, and sometimes replaced, by AI-driven tools that offer more nuanced and context-aware results. In the legal field, where timely and accurate information is crucial, these new search methods provide several benefits: 

  • Enhanced relevance: AI models can sometimes deliver more relevant search results by understanding natural language queries better. 
  • Streamlined access: Knowledge-driven industries, such as law, thrive on the efficient gathering and application of information. AI tools enhance access, positively impacting the quality and speed of work. 
  • Continuous improvement: The integration of AI in search processes exemplifies a commitment to ongoing enhancement of information accessibility. 

However, traditional retrieval methods still have their place, as they offer reliability and a different type of precision that AI is still striving to match. Our end-users are under pressure to find what they need, and natural language makes it easier for them to do just that. It is just a new route into knowledge. 

When you are using GenAI, keep the following in mind: 

  • Use clear prompts: Clearly outline your desired tone and provide ample context for your query. When utilising paywalled GenAI functionality, the more detailed the information you provide, the better the response. Publishers often offer guidance on how to use their tools effectively, so take advantage of this advice. As technology evolves, be prepared to refine your prompts accordingly. 
  • Verify everything: Don’t accept initial responses as fact. If something appears suspicious or unclear, challenge it. For instance, when ChatGPT provided statistics on the use of GenAI for legal research, I asked for the source, and it admitted the figures were illustrative. Always refer to trusted sources or consult with colleagues for verification. 
  • Critical evaluation: The intermediary nature of GenAI emphasises the need for critical evaluation of the information it provides. Users should be aware of potential inaccuracies and biases and verify crucial information through additional sources or direct searches. Employ your critical thinking skills to assess the validity and reliability of the data. 

 

Are you on the waiting list for SearchGPT? This looks like an interesting development. They say, “getting answers on the web can take a lot of effort, often requiring multiple attempts to get relevant results. We believe that by enhancing the conversational capabilities of our models with real-time information from the web, finding what you’re looking for can be faster and easier”. 

Conclusion

The integration of GenAI into law firms marks a transformative period in the field of information management. As we navigate this polarised landscape, the goal remains clear: to enhance access to better knowledge. Knowledge and information professionals are at the forefront of this journey, ensuring that AI systems are effective and reliable. 

By staying informed, fostering collaboration, and embracing continuous learning, these professionals can help law firms harness the full potential of GenAI while maintaining the integrity and accuracy of their legal outputs. The future of law is undeniably intertwined with the evolution of AI, and those who adapt will lead the way forward. 

Picture of Clare Bilobrk

Clare Bilobrk

Helping people maximise the visibility and usability of their knowledge and research services.
Sign up for our newsletter

SIGN UP FOR A FREE - 30 DAY TRIAL OF KNOWALL MATRIX

Try the powerful and easy-to-use KnowAll Matrix with no obligations, no commitment, no installation


Contact Email *
First Name *
Last Name *
Company Name *
Phone *
Lead Product Group 
Lead Status 
Contact Type 
Region 
Role 
Lead Source Detial 
*
*Required Fields
Note: It is our responsibility to protect your privacy and we guarantee that your data will be completely confidential.

Discover more from KnowAll Matrix - Your Knowledge, Information and Library Management Software

Subscribe now to keep reading and get access to the full archive.

Continue reading