When Surveillance Turns Around: How AI Is Changing the Balance of Power Between Citizens and Police

Chapter 6

Theme:
Font Size:
24px

A retention policy can limit this risk by specifying how long records may be stored and the circumstances in which longer retention is permitted. Deleting information that is no longer needed can reduce the amount of data available for misuse or unauthorized disclosure.

The principle applies to both public and private surveillance. A company that collects vehicle information for a defined operational purpose should not automatically assume that every future use of that information is appropriate. Likewise, a public agency should be able to explain why a database remains necessary and how its use is controlled.

Function creep demonstrates that surveillance is not a one-time decision. It is an ongoing governance challenge.

13. Data Security: What Happens After Information Is Collected?

Privacy discussions often focus on the initial act of recording information, but the security of the resulting data is equally important.

Once a surveillance system creates a database of vehicle sightings, the information must be stored somewhere. Depending on the system, it may be held locally on a computer, transferred to a remote server, or incorporated into a larger network.

Each arrangement introduces different technical and organizational considerations.

A local database may be easier to control in some respects, but it can still be vulnerable if the computer is compromised or if unauthorized people gain physical access. A networked system may support more flexible access and centralized management, but it also requires careful protection of connections, accounts, and stored records.

The appropriate safeguards depend on the system's design and the sensitivity of the information it contains.

At a minimum, responsible operators should consider who can access the data, how access is authenticated, whether records are protected against unauthorized disclosure, and how security incidents would be handled.

Access should be limited to people who have a legitimate reason to use the information. Different users may require different levels of permission, and administrative privileges should not be granted more broadly than necessary.

The system should also record significant actions, including searches and changes to stored information, where appropriate. Such logs can help identify unusual activity and support investigations if misuse occurs.

Security is not solely a technical matter. Organizations need procedures for granting and removing access, handling complaints, responding to suspected breaches, and ensuring that employees understand their responsibilities.

These issues become especially important when surveillance data is shared between organizations. Each additional recipient creates another point at which information may be copied, stored, or used.

The creator of a database may have limited control over what happens after the data is transferred to another party. That possibility reinforces the need to consider sharing arrangements before information is collected.

The risks are not limited to deliberate hacking. Accidental disclosure, weak account management, inappropriate internal access, and unnecessary duplication can all undermine privacy.

A system designed to demonstrate a technical concept may not require the same infrastructure as a professional deployment. However, the distinction between a demonstration and an operational database should be clear, particularly if the project begins to collect identifiable information over an extended period.

The easiest data to protect is often data that does not need to be collected in the first place. Limiting the amount of information stored can reduce both the consequences of a security incident and the burden of maintaining the system.

This principle supports a broader conclusion: responsible surveillance requires attention not only to what a camera can see, but also to what happens to the information after the camera has finished recording.

14. Journalism, Research, and the Public Interest

Sistilli's experiment also raises questions about the role of independent technology projects in public-interest research and journalism.

Many surveillance systems are difficult for the public to understand because their operation depends on specialized equipment, proprietary software, and databases that are not generally available for inspection. As a result, discussions about their capabilities may rely heavily on descriptions provided by the organizations that develop or operate them.

Independent demonstrations can help bridge that gap. By reproducing a simplified version of a system, a developer can show which functions are relatively easy to implement and which limitations become apparent in practice.

Such experiments can make technical issues more accessible to people who do not have a background in computer science. They can also generate useful questions for policymakers, researchers, and journalists.

For example, a demonstration of license plate recognition can encourage discussion about recognition accuracy, data retention, and the difference between collecting a single image and building a searchable database.

A project that reverses the usual direction of surveillance can also make institutional power easier to examine. Instead of discussing the monitoring of ordinary citizens only in abstract terms, the public can consider how similar tools might affect a different group.

However, public-interest experimentation still requires responsible judgment.

The fact that a project contributes to a debate does not mean that every method of conducting it is justified. Researchers and journalists must consider whether their work could expose people to unnecessary harm, whether they need to publish identifying information, and whether the same point can be demonstrated through less intrusive means.

For a project involving police vehicles, the decision to publish exact location records may have different consequences from the decision to explain the system's technical capabilities. A general demonstration may be sufficient to establish the main argument without creating an easily searchable database of individual sightings.

The distinction between showing that a technology works and exposing sensitive operational information is therefore important.

Good research also requires clarity about the limits of the evidence. A prototype that recognizes some license plates demonstrates a basic capability, but it does not establish that every commercial system performs in the same way. Nor does it prove that a particular surveillance network is being used unlawfully.

A responsible account should separate direct observations from broader conclusions, explain uncertainty, and avoid presenting a limited experiment as definitive evidence of every claim about surveillance.

These standards strengthen public debate rather than weaken it. A demonstration is most useful when its conclusions are proportionate to what it actually shows.

Sistilli's project is valuable precisely because its central point does not require exaggerated claims. Even an imperfect prototype can illustrate that some automated monitoring capabilities have become accessible to individual developers. That fact alone is enough to justify questions about governance, accountability, and privacy.

15. Ethical Responsibility in a World of Accessible AI

The increasing availability of AI-assisted software creates new opportunities for innovation, but it also changes the ethical responsibilities of people who build technological systems.

In the past, the complexity of certain tools may have limited the number of people capable of developing them. Today, AI-assisted programming can help developers understand unfamiliar libraries, generate code, troubleshoot errors, and assemble working prototypes more quickly.

This does not eliminate the need for technical knowledge. Developers still need to understand what the software does, how its components interact, and whether its outputs are reliable. Nevertheless, AI assistance can reduce the effort required to move from an idea to an initial implementation.

The result is a growing gap between the effort needed to create a capability and the effort society may need to understand or regulate its consequences.

A surveillance prototype may be relatively easy to assemble, while evaluating its legal implications, protecting the resulting data, and establishing appropriate limits can be much more complicated.

This imbalance is not unique to surveillance. Similar challenges arise whenever new technologies make it easier to collect information, automate decisions, or influence other people.

The appropriate response is not necessarily to discourage experimentation. Innovation can reveal weaknesses in existing systems and help society understand emerging capabilities before they become widespread.

Instead, developers should recognize that technical feasibility is only one part of responsible design.

They should ask what problem the system is intended to solve, whether collecting the information is necessary, who might be affected, and how the system could be misused. They should also consider whether the same objective can be achieved through a less intrusive design.

For AI-assisted projects, these questions are particularly important because generated code can make implementation appear simpler than it really is. A prototype may run successfully without providing adequate protection against errors, unauthorized access, or unexpected uses.

Developers should therefore distinguish between a proof of concept and a system suitable for real-world deployment. The former demonstrates that an idea can work under certain conditions; the latter requires broader testing, documentation, security measures, and consideration of its effects on people.

Sistilli's experiment illustrates both the promise and the challenge of this new environment. A relatively small project can communicate an important point about technological accessibility. Yet the moment such a system begins recording identifiable vehicles, questions arise that cannot be answered through programming alone.

News in the same category

When Surveillance Turns Around: How AI Is Changing the Balance of Power Between Citizens and Police

8 Part