Very good post for all of us and that supplement well the discussion ...Thanks you ...
You can view collective intelligence as the intelligence of individuals times the number of individuals times the reproduction (read: evolution) rate. In the middle of the spectrum between bacteria and humans are ants and bees.
This is so true that this collective intelligence was discovered recently for insects only in sociobiology studies (Wilson) and by others about the cells , bacteria and viruses etc ...
In psychology this collective intelligence is called "unconscious" by his discoverer Carl Gustav Jung why ? ( as i said Searle is wrong and dont understand why is the unconconscious stating that it is an uncoherent idea, materialism blind him )
Because no individual cells or insects know consciously as an individual what the collective intelligence knows...
Then we must realize that this collective intelligence is in reality a collective unconscious in relation with each individuals be it a cell or a human...
Now we must realize that the actual A.I. design ( which is not A.C. as designed by Anirban which i spoke of above) the actual A.I. design with LLM models takes all his information from the accumulated information of the human species at it is written on the web... Not as it is in an unspoken state in the collective human unconscious... )Please think about this deep distinction and its meaning i just make .
This A. I. is then only ONE MODE among others of tapping the human collective unconscious...
There is another mode to do it by creative human : meditation, studies and altered stated of consciousness in dreams in walking in Nature with psychotropic substance , with prayers as Ramanujan the greatest mathematician since Archimedes and Gauss etc ...
This second modality to tap the collective human unconscious, which is not a reading of all internet information bits, is completely different than A.I. and gave to human way more than just "intelligence" or "information" but what we called "wisdom" and judgement in the development of not only a mere unconscious intelligence as the ants which almost do anything human does but gave us a CONSCIOUS individuality not a mere unconscious individuality...
Judgement is not reducible to logical computation because judgement imply contextual meaning... And meaning transcend any of his narrow manifestations and unify them...
it is so true that language exceed in complexities our actual maths modelization... it is too complex... It is very easy for a man or a machine to learn language but it is not as easy to understand it... Why ? Because language is infinite on not one level but infinite on at least three semiotic levels : phonological, syntaxical and semantical (and pragmatical )... None of these levels is reducible to the others... No signs are arbitrary here , Saussure dogma about signs arbitrarity is a pure convenient working hypothesis but is wrong as a theory and Peirce is right ... Anyway... ( it is the same in maths where we use statistics as a convenient working hypothesis to study primes numbers distribution but this hypothesis dont work as a theory to explain the primes distribution which dont obey statistics)
If i come back to the collective unconscious of human where intelligence is located, i can understand why the individuals manifested it and how he can contribute to it : the how is called the soul as conscious and unconscious, it is a cell immersed in a cosmic information field which is infinite...Not finite as the web information is anyway... The soul is the roots by which the human conscious spirit is immersed in meanings and translate all symbolic forms in information and vice versa through dreams among others phenomenon.
A.I. unlike humans , had no roots in the collective unconscious of human , only an indirect relation to written bits by the web and only in prosaic language mode the poetical mode is over A.I. .
A. I. has no body. And the soul is a manifested informed body in his conscious and unconscious appearence . A. I. what so ever his future progress could be, will stay a FINITE MORTAL entity forever...Human are not mortal finite entity nor any living organism... The conscious /unconscious soul which inform and designed them as tenmporary manifestation this informative field is eternal as all of his individual cells are... Death is a tool for life not a state...
And mathemathics itself is grounded in a non logical non created by human phenomenon : the prime numbers distribution geometry matrix which is an eternal meaningful dynamical field and cell... Anirban used it to design A.C. over simple A. I.
AIs will be things as smart or smarter than us that can multiply as fast as bacteria. The best of both worlds.
The best of both worlds will be trying to stay human in a sea of A. I. in a corpocratic tyrannical society too immature now for so much power...
The best of both worlds will be learning to stay human in spite of A. I. limitations and absolute control...
The history of science and the history of consciousness on earth are related. We must learn how to not replace diying materialism by techno cultism in a hive society controlled as in bad S-F by corporations...It is Kurzweil and Gates idolatry and ideology...
Anyway the problem is way more complex than your description...
A.I. is already surpassed by new works in synthetic biology, by completely new information theory and new non- algorythmic non- Turing geometrical language with a new maths which will make us human able to design A.C. or artificial consciousness... Here the spiritual stake is even higher... The threat is also higher... With A. C. we have an autonomous A.I. artificially conscious self developing in the real world not gathering bits from the web merely...It is all explained in the many books of the genius Anirban Bandyopadhyay i cited above...
It is urgent to understand what we are individually and collectively...
We are not a simulation of a brain computer grounded at the neurons levels . The brain does not compute, it is an orchestration playing at 12 orders of magnitude under the Neurons levels in mocrotubules. As demonstrated Hameroff with Anirban already. but more than that the consciousness phenomenon cannot be understood in material spatial content information. It is a phenomenon only understood through the concept of time and timing as demonstrated by Anirban in his many books since 2020... We are not simulations in a simulation as thought by Wolfram erroneously... As said Goethe we are an instantiation of the universal in the individual . Not a machine at all ....No living organism can be understood as pure machine. NONE...
Maths is not a game it is the pure symbolic abstraction of the living soul... The brain and the cosmos body must be unified as ONE soul... It is way over the unification of relativity and Quantum mechanics.