Kalle Comments on AI, Knives and Money

Can We Be Trusted?

Humanity has walked forward carrying increasingly powerful tools, from fire through agriculture, industrialization, and modern economies. With AI, we now have to walk a new narrow ridge: using its extraordinary power to support our navigation toward attractive and scalable futures on the one hand, while avoiding and controlling the many risks and unintended consequences emerging along the way on the other. These risks cannot be wished away, nor avoided by refraining from the use of AI. On the contrary, the outcome depends on inspired and self-critical leadership using it, while responsibly developing and supporting the policies, governance systems, and laws capable of guiding its development and use.

Throughout history, humanity has developed increasingly powerful tools.

Fire. Agriculture. Money. Economy. Industrial technology…

And now AI.

Each has expanded our ability to shape the world. Each has created extraordinary opportunities. Each has introduced new risks. Yet history suggests that the greatest dangers rarely originate in the tools themselves. Furthermore, since evolution cannot be stopped – we simply need to manage the risks in order to harvest the benefits. And the benefits may, in the longer run, prove to be as essential for survival of civilization as a threat to it.

A knife may save a life in the hands of a skilled surgeon or take one in the hands of a criminal. The difference is not the knife. It is the purpose, competence, judgment, and accountability of the person holding it, in combination with governance structures and laws controlling it.

The same principle applies to AI.

This is why the AI debate sometimes becomes misleading. Too much attention is paid to whether technology itself should be trusted, and too little on what makes people, organizations and societies worthy of trust as we try to walk the line between essential opportunities and threats looming in the horizon. Where are the politicians in this? And what can we all do to walk the line?

Opportunities and threats. The opportunities are, perhaps, largely given. We need powerful tools to assist societal decision making in complex goals, not the least the endeavor of turning the largest threat to humanity ever, unsustainability, into a trajectory toward attractive and scalable opportunities for the future.

At the same time, much of the societal discourse focuses on the risk that AI could become a threat to civilization and our collective future. Such concerns are not without foundation. AI may create unforeseen consequences, for instance through AI-to-AI interactions in which independently developed systems begin generating emergent patterns of behavior that escape timely human oversight. Such dynamics could become particularly serious when linked to real-world operations such as armed conflict, cyberattacks, or sabotage. Other concerns include the displacement of workers, negative impacts on education at all levels, increasing energy demands associated with ever more powerful AI systems, growing dependence on interconnected infrastructures where local failures may propagate rapidly across society, and the possibility that enormous financial incentives may divert attention and resources away from the urgent sustainability challenges facing humanity.

In such ways, AI may contribute to unprecedented concentrations of economic, political, military, or informational power in the hands of a limited number of organizations, governments or individuals. At the same time, increasingly sophisticated and personalized communication may make it more difficult to distinguish independent judgment from engineered influence, creating new opportunities for manipulation of public opinion and societal discourse.

Finally, overreliance on AI assistance may gradually weaken important human capabilities such as critical thinking, independent judgment and deep learning. Some of the greatest long-term risks may therefore arise not because AI becomes less human, but because its power amplifies existing human weaknesses, institutional shortcomings, and failures of governance.

Creation of trust. Research from many fields points to three essential qualities. We tend to trust those (i) who seek the common good, (ii) possess the knowledge required to serve it, and (iii) remain guided by their values also when exposed to powerful temptations in other directions.

The greatest challenge may be the last: benevolence.

Not as a feeling, but as a sustained commitment to use power responsibly and in service of something larger than oneself and/or partial self-righteous communities.

Yet recognizing the risks of AI does not imply that people with good intentions should avoid it. Quite the contrary.

Deliberate resistance to mishaps. Major evolutionary shifts with huge stakes and threats cannot be stopped simply by wishing them away, nor by naïve hopes for the best. Resilience emerges from understanding them, participating in them, and helping direct them toward desirable outcomes.

If thoughtful and responsible people choose not to engage, they leave the shaping of this powerful technology to others. Instead, we need people who are prepared to help ensure that AI developments are guided by knowledge, ethical reflection and concern for the common good. This concerns not least political parties, which have remained surprisingly silent on how AI can be guided toward the common good and what governance structures are needed to reduce risks and prevent abuse.

As technology becomes more capable, the consequences of our choices become more significant. The essential question is whether our wisdom, ethics and systems of governance can evolve quickly enough to guide its use. The opportunities for AI to assist socially and ecologically attractive societies are enormous. So are the risks if its development and application are poorly guided.

In the end, this is not primarily a discussion about technology.

It is a discussion about ourselves.

The question is not whether AI can be trusted.

The question is whether we can be trusted with AI.

This Comment, like all Comments and Reflections on the StepWise Global platform, is intended to help asking the right questions about attractive futures within sustainable constraints.

Full Reflection see https://fssd.global/kalle-reflects/kalle-reflects-on-ai-knives-and-money/

Podcast see https://shows.acast.com/68c6a8718b1c6a4828eaa658/6a788f86b5c73bab7c9cf3ac

[1] Fact Box

The FSSD operative system, “ABCD-in-the-Funnel,” is the shared foundation behind Stepwise Global, Stegvis, Kalle’s Reflections, their associated podcasts, and related applications:

Funnel

The term funnel refers to the global context within which ABCD planning takes place. Many essential ecological and social systems are currently in systematic decline and, if current trends continue, will gradually undermine society’s ability to sustain itself. Examples include forests, cropland, groundwater reserves, biodiversity, and social trust.

Boundary Conditions

The funnel opening, representing sustainability for any system, organization, product, project, or society, is operationally defined by eight boundary conditions that are robust for planning. In a sustainable society, nature is not subject to systematically increasing:

1. Concentrations of substances extracted from the Earth’s crust (e.g., fossil carbon and metals).

2. Concentrations of substances produced by society (e.g., naturally occurring like nitrogen oxides, or synthetic like PFAS).

3. Degradation by physical means (e.g., overfishing and large-scale clear-cutting).

And, in that society, people are not exposed to structural barriers to:

4. Health (e.g., unsafe working conditions).

5. Influence (e.g., referendums leading to change).

6. Competence (e.g., access to education and learning).

7. Impartiality (e.g., fair representation in rooms of decion making).

8. Meaning-making (e.g., opportunities for purpose and contribution).

ABCD

(Not an acronym, but a simple sequence of four steps: A, B, C, and D.)

A = A vision of success, framed within the eight sustainability boundary conditions.

B = An assessment of current reality, including assets and challenges in relation to that vision.

C = A broad range of possible actions that could help bridge the gap between the current situation and the desired future.

D = A prioritized strategic action plan consisting of stepwise measures selected from the C-list.

For deeper exploration, please refer to the resources listed below.

References

For further Reflections, Podcasts, Applications, and Courses, Find all of them on Stepwise Global containing a broad range of reflections, podcasts, applications, educational resources, and courses related to strategic sustainable development and the use of the FSSD. www.stepwise.global/

Among the reflections addressing important aspects of the methodology itself, readers may find particular value in:

1. FSSD planning for social sustainability. fssd.global/kalle-reflects/kalle-reflects-on-social-sustainability-from-boundary-conditions-to-systemic-systematic-and-strategic-progress/

2. Latest peer-reviewed paper. This paper provides the scientific foundation of the Operative System and includes many more references to the underlying research and methodology. doi.org/10.1002/sd.3357

3. The scientific background to the above paper, presented as an easy read of physics and chemistry fssd.global/kalle-reflects/kalle-reflects-on-how-the-laws-of-nature-underpin-the-logic-of-the-operative-system/

4. Backcasting from Principles: the conceptual foundations and scientific logic of systems thinking through a lens of purpose. fssd.global/kalle-reflects/kalle-reflects-on-backcasting-for-strategic-thinking-and-ways-of-muddying-waters/

5. The psychology of ABCD Workshops: how the methodology is applied in practice and how group dynamics influence outcomes. fssd.global/kalle-reflects/kalle-reflects-on-the-psychology-of-abcd-in-funnel-workshops/

6. An Attractive Sustainable World (Step A): Because every system is nested within the larger global system, a model of a sustainable world within the boundary conditions determines the ultimate scalability of any specific organization, project, region, product, or other topic. fssd.global/kalle-reflects/kalle-reflects-in-concrete-terms-on-an-attractive-sustainable-world-at-a/

7. The C-list of ABCD planning: If the C-list is too thin or superficial, you run into the classic “poor data in, poor results out” problem when you use the Operative System.

8. The overriding success factor: when leaders are actively involved in intellectual performance fssd.global/kalle-reflects/kalle-reflects-on-success-and-failure-respectively-from-the-operative-systemabcd-in-funnel/

9. Economic growth: An overview of the current mis-informed discussion on economic growth, outlining two ditches as well as the high-road between them. fssd.global/kalle-reflects/kalle-comments-on-four-headed-elephant-in-the-economic-room/

10. The Plato cave and the psychological resistance amongst economists to take part in the development of a smarter economy, taking the above reflection seriously. fssd.global/kalle-reflects/kalle-reflects-on-the-plato-cave/

11. Reporting aligned with the FSSD: The typical lack of “strategic indicators” makes reporting meaningsless. fssd.global/kalle-reflects/kalle-comments-on-eu-directives-for-sustainability-reporting/

12. Ethics vs. criminals gaining from FSSD thinking, Enlightened self interest fssd.global/kalle-reflects/kalle-reflects-on-a-new-dawn-for-oligarchs/

13. The leading global example of supply chain management in the chemical industry? fssd.global/kalle-reflects/reflection-on-polymers-and-their-role-in-turning-current-destruction-into-scalable-solutions-for-the-future/

These resources provide additional perspectives on the practical implementation of the Operative System and its role in strategic planning for sustainability.