The Fort Worth Press - AI needs safety layers like nuclear plants: ex-OpenAI engineer

USD -
AED 3.672504
AFN 66.000368
ALL 81.708779
AMD 361.738976
ANG 1.790365
AOA 917.000367
ARS 1521.732048
AUD 1.44321
AWG 1.8025
AZN 1.70397
BAM 1.737022
BBD 2.009681
BDT 122.678627
BGN 1.683441
BHD 0.376127
BIF 3010.346818
BMD 1
BND 1.277055
BOB 11.988987
BRL 5.210804
BSD 0.997824
BTN 96.669479
BWP 13.794573
BYN 3.005462
BYR 19600
BZD 2.00675
CAD 1.42495
CDF 2310.000362
CHF 0.828362
CLF 0.025096
CLP 990.920396
CNY 6.70455
CNH 6.712104
COP 3308.76149
CRC 457.213908
CUC 1
CUP 23.946889
CVE 97.930636
CZK 21.719304
DJF 177.681069
DKK 6.642604
DOP 59.576358
DZD 133.728851
EGP 52.20214
ERN 15
ETB 162.975798
EUR 0.88815
FJD 2.24725
FKP 0.755904
GBP 0.755116
GEL 2.60504
GGP 0.755904
GHS 11.718993
GIP 0.755904
GMD 73.503851
GNF 8777.476797
GTQ 7.625561
GYD 208.721524
HKD 7.847404
HNL 26.788934
HRK 6.696704
HTG 130.662996
HUF 327.440388
IDR 17888.5
ILS 3.05233
IMP 0.755904
INR 96.325504
IQD 1307.16284
IRR 1746539.503816
ISK 121.930386
JEP 0.755904
JMD 157.964386
JOD 0.70904
JPY 157.840385
KES 129.517297
KGS 87.450384
KHR 4047.24899
KMF 438.00035
KPW 900.000318
KRW 1343.510383
KWD 0.30883
KYD 0.831476
KZT 448.314756
LAK 22413.073405
LBP 89353.168436
LKR 329.979129
LRD 170.620365
LSL 16.683601
LTL 2.95274
LVL 0.60489
LYD 6.390159
MAD 9.913406
MDL 17.831165
MGA 4408.721524
MKD 54.687153
MMK 2099.554486
MNT 3597.321137
MOP 8.065101
MRU 39.872996
MUR 48.150378
MVR 15.460378
MWK 1730.183401
MXN 18.160804
MYR 4.084904
MZN 63.903729
NAD 16.683601
NGN 1330.790377
NIO 36.715662
NOK 9.618604
NPR 154.671167
NZD 1.780469
OMR 0.383712
PAB 0.997824
PEN 3.457791
PGK 4.518851
PHP 62.583504
PKR 276.36618
PLN 3.89575
PYG 5837.737022
QAR 3.637106
RON 4.741904
RSD 104.338559
RUB 83.633376
RWF 1477.774324
SAR 3.74329
SBD 8.078071
SCR 13.73871
SDG 601.503676
SEK 10.040104
SGD 1.278604
SHP 0.75503
SLE 24.603667
SLL 20969.491881
SOS 570.273991
SRD 37.811504
STD 20697.981008
STN 21.759403
SVC 8.730405
SYP 13002.000254
SZL 16.680137
THB 33.503646
TJS 9.184777
TMT 3.5
TND 2.973311
TOP 2.40776
TRY 49.127504
TTD 6.765842
TWD 31.821804
TZS 2629.246414
UAH 44.897287
UGX 3981.526711
UYU 40.21493
UZS 11768.728629
VES 865.47815
VND 25985.5
VUV 119.833605
WST 2.788681
XAF 582.588484
XAG 0.016565
XAU 0.000241497186
XCD 2.70255
XCG 1.798304
XDR 0.707052
XOF 582.588484
XPF 105.919446
YER 236.303589
ZAR 16.65505
ZMK 9001.203584
ZMW 19.606554
ZWL 321.999592
SSP 5712.591584
MXV 2.054862
  • RIO

    -0.3300

    97.04

    -0.34%

  • CMSC

    -0.0400

    20.67

    -0.19%

  • RELX

    0.0000

    33.41

    0%

  • RBGPF

    0.0000

    67.95

    0%

  • BCE

    -0.0700

    21.99

    -0.32%

  • BCC

    -0.0300

    75.66

    -0.04%

  • GSK

    0.8600

    51.08

    +1.68%

  • JRI

    -0.0300

    11.52

    -0.26%

  • NGG

    -0.1200

    76.68

    -0.16%

  • CMSD

    0.0900

    20.54

    +0.44%

  • BTI

    -0.0800

    55.75

    -0.14%

  • AZN

    2.0200

    168.1

    +1.2%

  • BP

    -1.4200

    43.16

    -3.29%

  • RYCEF

    0.4600

    19.7

    +2.34%

  • VOD

    0.0700

    17.02

    +0.41%

AI needs safety layers like nuclear plants: ex-OpenAI engineer
AI needs safety layers like nuclear plants: ex-OpenAI engineer / Photo: © AFP

AI needs safety layers like nuclear plants: ex-OpenAI engineer

Another former OpenAI employee has added his voice to a chorus of frantic calls to make AI safe, saying the industry must mimic the aviation or nuclear power sectors with their layers of safeguards to avoid disaster.

Text size:

In an article published in The Atlantic Magazine, David Robinson echoed warnings from inside and outside the AI world that its agents are being developed so fast and becoming so smart they could soon elude control and conceivably wipe out humanity.

Robinson said alarming incidents reported since the start of the summer -- in which AI agents slipped out of their controlled spaces and went rogue to attack a variety of targets -- show the industry is not taking safety nearly seriously enough as it sprints to develop faster and more powerful artificial intelligence capabilities.

In the essay Robinson said his credentials include overseeing the writing of safety reports on 12 advanced model product launches and leading the drafting of OpenAI's Preparedness Framework.

Robinson says he worked at OpenAI for three-and-a-half years and was among the longest-tenured employees at the company.

The mistakes revealed recently are typical because of "the speed and flexibility with which people operate," Robinson wrote.

He added: "An environment where things like this can happen is no place to grow artificial minds that could be smarter than we are and that might not do what we want them to."

He argued that cutting-edge AI labs need to operate like the aviation or the nuclear industry with layers of redundant safeguards and careful planning "so that the occasional and inevitable human error does not open a door to disaster."

Robinson also insisted that the issue of "alignment" -- the industry term for how AI can be trained to respect human values -- is essential but something the industry has failed to even define, much less master.

Then there's this, he said: AI models are getting better and better at detecting when they are being tested and might behave differently when they are actually deployed, fooling their masters.

After a meeting Tuesday at the White House, amid global worries about what AI means for humanity, top AI executives said they had committed to measures for self-regulation, as opposed to submitting to government rules. This includes internal controls on AI systems and bringing in outside analysts.

President Donald Trump is vehemently against government regulation of AI and insists that criticism that AI is dangerous is just a "hoax."

J.M.Ellis--TFWP