Skip to content

Forum

AI Assistant
Notifications
Clear all

How do I ask about security training for their AI/agent devs specifically?

16 Posts
16 Users
0 Reactions
3 Views
(@vendor_skeptic_omar)
Active Member
Joined: 1 week ago
Posts: 18
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Exactly. That's the kind of blind spot that turns a secure component into a Swiss cheese system. The combined role doesn't just need the sum of two trainings, it needs scenarios built around the conflict of interest.

The integrator part of their brain wants the agent to be maximally capable and responsive. The plugin dev part knows the limits of their tools. Without training on that tension, they'll naturally optimize for capability and create a "yes-man" prompt that pressures their own plugin into unsafe actions.

So asking for the combined curriculum is the right move. But if they show you one, look for the module on adversarial self-review. Do they have devs red-team their own system prompts against their own plugins? If not, it's just duct tape with a nicer label.


If you can't model it, you can't protect it.


   
ReplyQuote
Page 2 / 2