The U.S. ambassador to Japan expressed regret on Saturday for the handling of two cases of sexual assaults allegedly committed by American military service members stationed in Okinawa.

The issue arose late last month, triggering an uproar over reports that two American service members had been charged with sexual assaults months earlier.

Both cases were first reported in local media in late June. In one arrest made in March, a member of the U.S. Air Force was charged with the kidnapping and sexual assault of a teenager, and in May, a U.S. Marine was arrested on charges of attempted rape resulting in injury. Further details about the alleged victims were not released.

Okinawa police said they did not announce the cases out of privacy considerations related to the victims. The Foreign Ministry, per police decision, also did not notify Okinawa prefectural officials.

U.S. Ambassador Rahm Emanuel said on Saturday he deeply regretted what happened to the individuals, their families and their community, but fell short of apologizing.

“Obviously, you got to let the criminal justice process play out. But that doesn’t mean you don’t express on a human level your sense of regret.”

“We have to do better,” he said, adding that the U.S. military’s high standards and protocols for education and training of its troops was “just not working.”

Okinawa accounts for just 0.6% of Japan’s land mass but hosts about 70% of all the U.S. military bases and facilities in the country.

The two cases stoked resentment of the heavy U.S. troop presence on the strategic island in Japan’s far southwest. They are also a minder of the 1995 gang rape of a 12-year-old girl by three U.S. service members. It led to a 1996 agreement between Tokyo and Washington to close a key U.S. air base, although the plan has been repeatedly delayed due to protests at the site designated for its replacement on another part of the island.

Emanuel said the U.S. may be able to propose measures to improve training and transparency with the public at U.S.-Japan foreign and defense ministers’ security talks expected later this month in Tokyo.

On Friday, Chief Cabinet Secretary Yoshimasa Hayashi said the Japanese authorities would do their utmost to provide more prompt disclosures of alleged crimes related to U.S. military personnel on Okinawa while protecting victims’ privacy.

The cases could be a setback for the defense relationship at a time when Okinawa is seen as increasingly important in the face of rising tensions with China.

Some 50,000 U.S. troops are deployed in Japan under a bilateral security pact, about half of them on Okinawa, where residents have long complained about heavy U.S. troop presence and related accidents, crime and noise.

Emanuel commented on the issue while visiting Fukushima, on Japan’s northeast coast.

Earlier Saturday, the ambassador visited the nearby town of Minamisoma to join junior surfers and sample locally-caught flounder for lunch, aiming to highlight the safety of the area’s seawater and seafood amid ongoing discharges of treated and diluted radioactive water from the tsunami-ruined Fukushima Daiichi nuclear power plant.

China has banned Japanese seafood over the discharges, a move Emanuel criticized as unjustified.