Red hackers play an important role in companies to test technologies from different angles.
Artificial intelligence is here to stay, but there is still a long way to go to regulate it, and it presents difficulties in generating concrete information. Another problem is that AIs have been trained in this world, where racism, classism, and sexism are a reality; therefore, they have adopted that.
Therefore, companies need red hackers to test technologies from different angles; this in order to detect errors, which can be dangerous by stigmatizing a group of people. Therefore, the role of a red hacker is to check the security systems of the company that hires him/her.
Experts point out that this professional profile will be increasingly in demand. In addition, it should be remembered that there are studies that indicate that artificial intelligence will create more jobs than it will eliminate; this profession could be one of those that will gain momentum thanks to AI.
The importance of red hacker teams
As large enterprises strive to build and release generative AI tools, the importance of the role of their internal AI teams increases since it is elemental to ensure that the models are safe for society. In addition, these teams provide a competitive advantage to technology companies in the AI race.
According to Cristian Canton, an AI engineer at Meta, red teams not only query an AI model to generate toxic responses, they extract training data that unveils personal information, such as names, addresses, and phone numbers; they then apply a tactic to change some of the information before using it to train the model.
These teams have a big challenge, as they must balance the security of AI models but without major constraints to remain relevant and usable, with sufficient information.
Finally, the Universidad Internacional Iberoamericana (International Iberoamerican University) (UNIB) offers the Master in Strategic Management with a Specialty in Information Technology.
