When Your Software Quietly Gets Smarter: Managing AI You Never Chose

Introduction

Two years ago you evaluated a vendor. You looked at their security documentation, checked their certifications, asked where your data would live, and signed an agreement you were comfortable with. That review was thorough, and at the time it was accurate.

The product you approved doesn’t exist in that form anymore.

Your CRM now summarizes customer calls. Your helpdesk drafts responses automatically. Your accounting platform flags anomalies using a model that wasn’t there last year. None of these arrived as a new contract or a renegotiation. They showed up as product updates, announced in a release note or a banner in the corner of a dashboard, and your team started using them the same week.

You approved a vendor. You didn’t approve a vendor plus a model, and in most cases nobody asked whether you wanted to.

The Update That Changes the Agreement

Here’s what makes this different from ordinary feature releases. When a vendor adds AI to a product, the data your business already handed over frequently becomes an input to something new. Support tickets, customer records, uploaded documents, and internal notes all become material a model can process, and sometimes material it can learn from.

Vendors have largely handled this through terms-of-service updates rather than negotiated contract amendments. That’s an efficient approach for them and an easy one to miss on your end, since revised terms tend to arrive by email among dozens of other notices and take effect whether or not anyone opens them. The language that permits it is usually already in your agreement. Clauses allowing a vendor to process customer data to “improve” or “enhance” their services were written long before generative AI existed, and they’re now doing work nobody anticipated when they were signed.

The scale of this isn’t small. An analysis of contract data by TermScout, working with Stanford Law School’s CodeX center, found that 92 percent of AI contracts claim data usage rights beyond what’s needed to deliver the service, compared with a market average of 63 percent across software agreements generally. Some even permit customer data to be used for competitive intelligence.

This Isn't Hypothetical

Two well-known cases show how visible this has become. Adobe faced significant customer backlash after updated terms appeared to grant broad rights over user content, and the company ultimately clarified its policies and committed not to train AI systems on customer data. Figma was hit with a proposed class action in late 2025 alleging it used customer designs to train generative tools without permission, a claim the company denied.

Both involved large vendors with sophisticated legal teams and attentive customer bases. The interesting question isn’t what happened at Adobe or Figma. It’s what’s happening at the fifteen smaller vendors your business uses that nobody is watching as closely.

Five Questions You Should Ask Your Top Vendors

You don’t need to interrogate every vendor. Start with the handful that hold your most sensitive data, which for most businesses means five or six relationships. Ask each one:

  • What AI features have been added to our account in the past year, and are any enabled by default?
  • Is our data used to train or fine-tune any model, including third-party models you rely on?
  • If AI features process our data, is it retained afterward, and for how long?
  • Which third-party AI providers, if any, does our data pass through?
  • How will you notify us when this changes?

The last question matters more than it looks. A vendor who commits in writing to advance notice has given you something the others haven’t, which is time to make a decision rather than discovering a change after the fact.

What to Fix at Renewal

Contract language is where this gets resolved, and renewal is when you have leverage. The practical asks are narrow: an explicit prohibition on using your data for model training without written consent, a requirement that new AI features be disclosed before activation, and clarity on who owns the outputs generated from your data.

Vendors won’t always agree, and a refusal is informative on its own. Where a vendor won’t commit to opt-in, the common middle ground is zero-retention processing, meaning your data can be used to generate output but isn’t kept for any training purpose. That’s a reasonable landing spot, and most established vendors can accommodate it.

This is the same discipline that applies to any vendor relationship holding your customers’ data. AI just changed what’s at stake without changing the paperwork.

Final Perspective

Most businesses have spent the past two years thinking carefully about the AI tools they chose to adopt. Far fewer have looked at the AI that arrived inside software they’d already bought, which is now the larger share of it.

The businesses handling this well aren’t blocking AI features or treating vendors as adversaries. They’re asking straightforward questions, getting answers in writing, and fixing the contract language at renewal instead of after an incident.

At Secutor, we help organizations review their vendor relationships, understand where AI has entered their supply chain, and put the right terms in place before the next renewal cycle. If you’re not sure which of your vendors are processing your data through a model, that’s a good conversation to start.

You can’t govern what you don’t know you’ve agreed to.

Connect with an Expert for a Free Consultation

Secutor is your team of world-class problem solvers with vast expertise and experience delivering complete solutions keeping your organization protected, audit-ready, and running smoothly. Use the form below to contact us for a free consultation.

Enjoyed this Content?

Share this story on social media!

Scroll to Top

Jason Fruge

Consulting Chief Information Security Officer (CISO)

Jason Fruge is an accomplished Consulting Chief Information Security Officer at Secutor Cybersecurity, bringing over 25 years of deep expertise in information security. His storied career includes leading and managing robust security programs for Fortune 500 companies across retail, banking, and fintech sectors. His current role involves providing strategic guidance and advisory services to clients, focusing on security governance, risk management, and compliance.

Apart from his consulting responsibilities, Jason is an active member of the global cybersecurity community. He is a Villager at Team8, a prestigious collective of senior cybersecurity executives and thought leaders. Additionally, he serves as an Advisor at NightDragon, an innovative growth and venture capital firm specializing in cybersecurity and enterprise technologies.

Jason’s tenure as a CISO is marked by a proven track record in developing and implementing comprehensive security policies and procedures. He adeptly leverages security frameworks and industry best practices to mitigate risks, safeguarding sensitive data and assets. His expertise encompasses incident response and root cause analysis, where he has notably managed cyber incidents to prevent breaches and minimize business disruption and customer impact.

A key aspect of Jason’s role has been the creation and facilitation of executive and board-level cyber risk committees, ensuring organizational alignment and awareness. His responsibilities have extended to maintaining compliance programs for standards such as PCI and SOX, as well as leading privacy and business continuity programs. Holding prestigious certifications like CISSP, QSA, and QTE, Jason is also a recognized thought leader, contributing articles on cybersecurity to InformationWeek.

Jason’s passion lies in driving innovation and fostering collaboration in the cybersecurity field. He is currently seeking an executive CISO role in a leading retail, finance, or fintech organization, where he can continue to make significant contributions to the cybersecurity landscape.

Jennifer Bayuk

Cybersecurity Risk Management Expert

Jennifer Bayuk is a highly esteemed cybersecurity risk management thought leader and subject matter expert at Secutor Cybersecurity. Her extensive experience encompasses managing and measuring large-scale cybersecurity programs, system security architecture, and a wide array of cybersecurity tools and techniques. Jennifer’s expertise is further deepened with her proficiency in cybersecurity forensics, the audit of information systems and networks, and technology control processes.

Jennifer’s skill set is comprehensive, including specialization in cybersecurity risk and performance indicators, technology risk awareness education, risk management training curriculum, and system security research. Her academic achievements are noteworthy, holding Masters degrees in Philosophy and Computer Science, and a Ph.D. in Systems Engineering. This strong academic background provides a solid foundation for her practical and strategic approach to cybersecurity challenges.

Certified in Information Systems Audit, Information Systems Security, Information Security Management, and IT Governance, Jennifer is a well-rounded professional in the field. Her credentials are further enhanced by her license as a New Jersey Private Investigator, adding a unique dimension to her cybersecurity expertise.

At Secutor, Jennifer plays a pivotal role in steering cybersecurity initiatives, aligning them with organizational risk appetites and strategic objectives. Her ability to educate and train in the realm of technology risk has been instrumental in raising awareness and enhancing the cybersecurity posture of our clients. Her dedication to research and continual learning makes her an invaluable resource in navigating the ever-evolving cybersecurity landscape.

Jennifer Bayuk’s blend of academic prowess, practical experience, and certifications make her an indispensable part of our team, as she continues to drive forward-thinking cybersecurity solutions and risk management strategies.

Steve Blanding

CISO Consultant

CISSP, CISA, CGEIT, CRISC

Steve is an IT management consultant living in Dallas, TX. Steve has over 35 years of experience in executive IT leadership, IT governance, risk and compliance (GRC), systems auditing, quality assurance, information security, and business resumption planning for large corporations in the Big-4 professional services, financial services, manufacturing, retail electronics, and defense contract industries. He has extensive experience with industry best practices for adopting and implementing new technologies, IT service management frameworks, and GRC solutions that have dramatically improved customer satisfaction while reducing cost.

Industry Experience

  • State Government: 5 years
  • Retail: 5 years
  • Defense Contract: 5 years
  • Manufacturing: 2 years
  • Health Care: 2 years
  • Local Government: 2 years
  • Public Accounting (Big 4): 7 years
  • Insurance: 3 years
  • Financial Services: 5 years

Key Career Accomplishments

  • Conducted a full-scale ISO27000 audit 4 times over the past 6 years.  Also, conducted a “light” ISO27000 review of a small Dallas-based company in 2007.
  • Developed and authored a comprehensive IT security policy manual, incident response plans, training programs, security contingency plans and configuration management plans for FedRAMP regulatory compliance.
  • Conducted multiple DR and operational backup and recovery IT risk assessments of critical business systems on mainframe, LAN, and distributed system networks located across North America.
  • Conducted data centers audits for Tyco Corporation (Brussels, 2005 and Denver, 2006), Farmers Insurance (Los Angeles, 2006), Zurich Financial Services (Chicago, Kansas City, and Grand Rapids, 2006), and Convergys Corporation (Dallas, 2010, 2011, and 2012).
  • Led a project to remediate segregation of duties and streamline user access system security and HIPAA compliance administration across 5 regions in North America, resulting in cost savings of $700,000 per year (Kaiser Permanente).
  • Implemented Sarbanes-Oxley Section 302 and 404 IT general and application controls, reducing security administration costs and improving operational performance by 50% or $500,000 annually (Tyco Corporation).
  • Led the global SAP business-IT alignment, process re-design implementation initiative for financial accounting, materials management, production planning, quality management, sales and distribution, warehouse management, and plant maintenance, which resulted in creating $2,000,000 in cost savings.
  • Engaged by Arthur Andersen in Houston to transform the local IT organization and then direct 3 organizational mergers/consolidations, which resulted in a 25% reduction in operating costs, or $3,250,000, while improving customer satisfaction by 30%, and improving employee morale, technology availability and the quality of IT infrastructure and service delivery.
  • Assigned by Arthur Andersen global leadership to lead global project teams responsible for data center and customer support call center consolidation, which resulted in annual operational cost savings of 45% or $4,000,000.
  • Implemented ITIL service management practices for problem management, incident management, help desk, project management, and operations management.
  • Conducted SOX 404 audits at Duke Energy (6 months), Red Hat (3 months), Tyco (9 months), Zeon Chemicals (4 months), and Convergys (2 months). Experience includes control design/documentation and effectiveness testing.

Publications:

Author, various articles in EDPACS and Auerbach’s IT Audit Portfolio Series, 1981 – 2001

Author, various articles in the Handbook of Information Security Management, 1993 – 1995

Editor, Auerbach’s Enterprise Operations Management, 2002

Editor, Auerbach’s IT Audit Portfolio Series, 2000 – 2002

Consulting Editor, Auerbach’s EOM Portfolio Series, 1998 -2001

Ready to Find Your Solution?

Reach out using the form below, and we’ll contact you as soon as possible to schedule your consultation.

Ready to Find Your Solution?

Use the form to schedule a consultation, and we’ll reach out within 48 hours to confirm the appointment.

Considering this delay, please only select meeting dates 48 hours or more in advance. Your information will only be used to facilitate a meeting.