Irodalom
Abernethy, Robert B. 2006. The New Weibull Handbook. 5th ed. R.
B. Abernethy.
Abonyi, János, and Tímea Fülep. 2014. Biztonságkritikus
Rendszerek. Pannon Egyetem.
AIAG, and VDA. 2019. Failure Mode and Effects Analysis –
FMEA Handbook. Automotive Industry Action Group;
Verband der Automobilindustrie.
Amodei, Dario, Chris Olah, Jacob Steinhardt, Paul Christiano, John
Schulman, and Dan Mané. 2016. “Concrete Problems in
AI Safety.” arXiv Preprint
arXiv:1606.06565.
Assurance Case Working Group. 2021. Goal Structuring Notation
Community Standard, Version 3. SCSC-141C. Safety-Critical Systems
Club.
Avižienis, Algirdas. 1985. “The N-Version Approach to
Fault-Tolerant Software.” IEEE Transactions on Software
Engineering SE-11 (12): 1491–501.
Avižienis, Algirdas, Jean-Claude Laprie, Brian Randell, and Carl
Landwehr. 2004. “Basic Concepts and Taxonomy of Dependable and
Secure Computing.” IEEE Transactions on Dependable and Secure
Computing 1 (1): 11–33. https://doi.org/10.1109/TDSC.2004.2.
Bainbridge, Lisanne. 1983. “Ironies of Automation.”
Automatica 19 (6): 775–79. https://doi.org/10.1016/0005-1098(83)90046-8.
Behm, Patrick, Paul Benoit, Alain Faivre, and Jean-Marc Meynadier. 1999.
“Météor: A Successful Application of B in a Large
Project.” FM’99 – Formal Methods, Lecture notes in
computer science, vol. 1708: 369–87.
Birnbaum, Zygmunt W. 1969. “On the Importance of Different
Components in a Multicomponent System.” In Multivariate
Analysis II, edited by P. R. Krishnaiah. Academic Press.
Borst, M. van der, and H. Schoonakker. 2001. “An Overview of
PSA Importance Measures.” Reliability
Engineering & System Safety 72 (3): 241–45.
Bryant, Randal E. 1986. “Graph-Based Algorithms for
Boolean Function Manipulation.” IEEE
Transactions on Computers C-35 (8): 677–91. https://doi.org/10.1109/TC.1986.1676819.
Buncefield Major Incident Investigation Board. 2008. The
Buncefield Incident 11 December 2005: The Final Report of
the Major Incident Investigation Board. HSE Books.
Bureau d’Enquêtes et d’Analyses. 2012. Final Report on the Accident
on 1st June 2009 to the Airbus A330-203 Registered
F-GZCP Operated by Air France Flight AF
447 Rio de Janeiro–Paris. BEA.
Butler, Ricky W., and George B. Finelli. 1993. “The Infeasibility
of Quantifying the Reliability of Life-Critical Real-Time
Software.” IEEE Transactions on Software Engineering 19
(1): 3–12. https://doi.org/10.1109/32.210303.
CENELEC. 2017. EN 50126-1: Railway Applications – the
Specification and Demonstration of Reliability, Availability,
Maintainability and Safety (RAMS) – Part 1: Generic
RAMS Process.
CENELEC. 2018. EN 50129: Railway Applications –
Communication, Signalling and Processing Systems – Safety Related
Electronic Systems for Signalling.
CENELEC. 2023. EN 50716: Railway Applications –
Requirements for Software Development.
Center for Chemical Process Safety. 2001. Layer of Protection
Analysis: Simplified Process Risk Assessment. American Institute of
Chemical Engineers.
Center for Chemical Process Safety. 2015. Guidelines for Initiating
Events and Independent Protection Layers in Layer of Protection
Analysis. American Institute of Chemical Engineers – Wiley.
Center for Chemical Process Safety, and Energy Institute. 2018. Bow
Ties in Risk Management: A Concept Book for Process Safety.
American Institute of Chemical Engineers – Wiley.
Cox, Louis Anthony. 2008. “What’s Wrong with Risk
Matrices?” Risk Analysis 28 (2): 497–512. https://doi.org/10.1111/j.1539-6924.2008.01030.x.
Cullen, W. Douglas. 1990. The Public Inquiry into the Piper
Alpha Disaster. Cm 1310. HMSO.
Cybersecurity and Infrastructure Security Agency. 2019.
MAR-17-352-01 HatMan – Safety System
Targeted Malware (Update B). CISA.
Delmas, David, and Jean Souyris. 2007. “Astrée: From Research to
Industry.” Static Analysis (SAS 2007), Lecture notes in
computer science, vol. 4634: 437–51.
Denney, Ewen, Ganesh Pai, and Ibrahim Habli. 2015. “Dynamic Safety
Cases for Through-Life Safety Assurance.” Proceedings of the
37th IEEE/ACM International Conference on Software Engineering
(ICSE) 2: 587–90. https://doi.org/10.1109/ICSE.2015.199.
Diemert, Simon, and Jens H. Weber. 2023. “Can Large Language
Models Assist in Hazard Analysis?” Computer Safety,
Reliability, and Security. SAFECOMP 2023 Workshops, Lecture notes
in computer science, vol. 14182: 410–22.
Dugan, Joanne Bechta, Salvatore J. Bavuso, and Mark A. Boyd. 1992.
“Dynamic Fault-Tree Models for Fault-Tolerant Computer
Systems.” IEEE Transactions on Reliability 41 (3):
363–77. https://doi.org/10.1109/24.159800.
EEMUA. 2013. EEMUA Publication 191: Alarm Systems – a
Guide to Design, Management and Procurement. 3rd ed.
EGAS Workgroup. 2015. Standardized E-Gas Monitoring
Concept for Gasoline and Diesel Engine Control Units. Version 6.0.
Verband der Automobilindustrie (VDA) – Arbeitskreis EGAS.
Endsley, Mica R. 1995. “Toward a Theory of Situation Awareness in
Dynamic Systems.” Human Factors 37 (1): 32–64. https://doi.org/10.1518/001872095779049543.
Ericson, Clifton A. 1999. “Fault Tree Analysis – a
History.” Proceedings of the 17th International System Safety
Conference (Orlando, FL).
Európai Parlament és Tanács. 2012. 2012/18/EU Irányelv a Veszélyes
Anyagokkal Kapcsolatos Súlyos Balesetek Veszélyének Kezeléséről (Seveso
III.).
Európai Parlament és Tanács. 2023. (EU) 2023/1230 Rendelet a
Gépekről.
Európai Parlament és Tanács. 2024a. (EU) 2024/1689 Rendelet a
Mesterséges Intelligenciára Vonatkozó Harmonizált Szabályok
Megállapításáról (Mesterséges Intelligenciáról Szóló Rendelet).
Európai Parlament és Tanács. 2024b. (EU) 2024/2847 Rendelet a
Digitális Elemeket Tartalmazó Termékekre Vonatkozó Horizontális
Kiberbiztonsági Követelményekről (Kiberrezilienciáról Szóló
Jogszabály).
Európai Parlament és Tanács. 2026. Rendelet Az (EU) 2024/1689
Rendeletnek a Mesterséges Intelligenciára Vonatkozó Harmonizált
Szabályok Végrehajtásának Egyszerűsítése Tekintetében Történő
Módosításáról (Digitális Omnibusz a Mesterséges Intelligenciáról).
Fussell, Jerry B. 1975. “How to Hand-Calculate System Reliability
and Safety Characteristics.” IEEE Transactions on
Reliability R-24 (3): 169–74.
Fussell, Jerry B., and William E. Vesely. 1972. “A New Methodology
for Obtaining Cut Sets for Fault Trees.” Transactions of the
American Nuclear Society 15: 262–63.
Gertman, David, Harold Blackman, Julie Marble, James Byers, and Curtis
Smith. 2005. The SPAR-H Human Reliability Analysis
Method. NUREG/CR-6883. U.S. Nuclear Regulatory Commission.
Goldberg, Bruce E., Kay Everhart, Rachel Stevens, Nelson Babbitt, Pat
Clemens, and Leslie Stout. 1994. System Engineering
“Toolbox” for Design-Oriented Engineers. NASA
Reference Publication No. 1358. NASA Marshall Space Flight Center.
Haddon, William. 1973. “Energy Damage and the Ten Countermeasure
Strategies.” Journal of Trauma 13 (4): 321–31.
Haddon-Cave, Charles. 2009. The Nimrod Review: An
Independent Review into the Broader Issues Surrounding the Loss of the
RAF Nimrod MR2 Aircraft XV230 in
Afghanistan in 2006. HC 1025. The Stationery Office.
Hauge, Stein, Mary Ann Lundteigen, Per Hokstad, and Solfrid Håbrekke.
2013. Reliability Prediction Method for Safety Instrumented Systems
– PDS Method Handbook. SINTEF A24442. SINTEF.
Hawkins, Richard, Colin Paterson, Chiara Picardi, Yan Jia, Radu
Calinescu, and Ibrahim Habli. 2021. Guidance on the Assurance of
Machine Learning in Autonomous Systems (AMLAS).
Assuring Autonomy International Programme, University of York.
Hayhurst, Kelly J., Dan S. Veerhusen, John J. Chilenski, and Leanna K.
Rierson. 2001. A Practical Tutorial on Modified Condition/Decision
Coverage. NASA/TM-2001-210876. NASA Langley Research Center.
Health and Safety Executive. 2001. Reducing Risks, Protecting
People: HSE’s Decision-Making Process. HSE Books.
Health and Safety Executive. 2003. Out of Control: Why Control
Systems Go Wrong and How to Prevent Failure. 2nd ed. HSE Books.
Heinrich, Herbert W. 1931. Industrial Accident Prevention: A
Scientific Approach. McGraw-Hill.
Hollnagel, Erik. 2014. Safety-I and
Safety-II: The Past and Future of Safety Management.
Ashgate.
IEC. 2009--2024. IEC 62443: Security for Industrial
Automation and Control Systems (Szabványsorozat).
IEC. 2006a. IEC 61025: Fault Tree Analysis
(FTA). 2nd ed.
IEC. 2006b. IEC 61165: Application of
Markov Techniques. 2nd ed.
IEC. 2006c. IEC 62304: Medical Device Software –
Software Life Cycle Processes.
IEC. 2010a. IEC 61508-1…7: Functional Safety of
Electrical/Electronic/Programmable Electronic Safety-Related
Systems. 2nd ed. International Electrotechnical Commission.
IEC. 2010b. IEC 62502: Analysis Techniques for
Dependability – Event Tree Analysis (ETA).
IEC. 2015. IEC 60050-192: International
Electrotechnical Vocabulary – Part 192: Dependability.
IEC. 2016a. IEC 61078: Reliability Block Diagrams.
3rd ed.
IEC. 2016b. IEC 61511-1: Functional Safety – Safety
Instrumented Systems for the Process Industry Sector – Part 1:
Framework, Definitions, System, Hardware and Application Programming
Requirements. 2nd ed.
IEC. 2016c. IEC 61882: Hazard and Operability Studies
(HAZOP Studies) – Application Guide. 2nd ed.
IEC. 2018. IEC 60812: Failure Modes and Effects
Analysis (FMEA and FMECA). 3rd ed.
IEC. 2019a. IEC 31010: Risk Management – Risk
Assessment Techniques. 2nd ed.
IEC. 2019b. IEC TR 63069: Industrial-Process
Measurement, Control and Automation – Framework for Functional Safety
and Security.
IEC. 2021. IEC 62061: Safety of Machinery – Functional
Safety of Safety-Related Control Systems. 2nd ed.
ISA. 2016. ANSI/ISA-18.2: Management of Alarm Systems
for the Process Industries.
ISO. 2010. ISO 12100: Safety of Machinery – General
Principles for Design – Risk Assessment and Risk Reduction.
ISO. 2016. ISO/TS 15066: Robots and Robotic Devices –
Collaborative Robots.
ISO. 2018a. ISO 26262-1…12: Road Vehicles – Functional
Safety. 2nd ed.
ISO. 2018b. ISO 31000: Risk Management –
Guidelines. 2nd ed.
ISO. 2019. ISO 14971: Medical Devices – Application of
Risk Management to Medical Devices. 3rd ed.
ISO. 2022. ISO 21448: Road Vehicles – Safety of the
Intended Functionality.
ISO. 2023. ISO 13849-1: Safety of Machinery –
Safety-Related Parts of Control Systems – Part 1: General Principles for
Design. 4th ed.
ISO. 2024. ISO/PAS 8800: Road Vehicles – Safety and
Artificial Intelligence.
ISO. 2025a. ISO 10218-1/-2: Robotics – Safety
Requirements.
ISO. 2025b. ISO/TS 5083: Road Vehicles – Safety for
Automated Driving Systems – Design, Verification and Validation.
ISO/IEC. 2014. ISO/IEC Guide 51: Safety Aspects –
Guidelines for Their Inclusion in Standards. 3rd ed.
ISO/IEC. 2024. ISO/IEC TR 5469: Artificial Intelligence
– Functional Safety and AI Systems.
ISO/SAE. 2021. ISO/SAE 21434: Road Vehicles –
Cybersecurity Engineering.
Joint Authorities Technical Review. 2019. Boeing 737
MAX Flight Control System: Observations, Findings, and
Recommendations. Federal Aviation Administration.
Kalra, Nidhi, and Susan M. Paddock. 2016. “Driving to Safety: How
Many Miles of Driving Would It Take to Demonstrate Autonomous Vehicle
Reliability?” Transportation Research Part A: Policy and
Practice 94: 182–93. https://doi.org/10.1016/j.tra.2016.09.010.
Kaplan, Edward L., and Paul Meier. 1958. “Nonparametric Estimation
from Incomplete Observations.” Journal of the American
Statistical Association 53 (282): 457–81. https://doi.org/10.1080/01621459.1958.10501452.
Kelly, Timothy P. 1998. “Arguing Safety – a Systematic Approach to
Managing Safety Cases.” PhD thesis, University of York.
Kelly, Tim, and Rob Weaver. 2004. “The Goal Structuring Notation –
a Safety Argument Notation.” Proceedings of the Dependable
Systems and Networks 2004 Workshop on Assurance Cases.
Kirwan, Barry. 1994. A Guide to Practical Human Reliability
Assessment. Taylor & Francis.
Klein, Gerwin, Kevin Elphinstone, Gernot Heiser, et
al. 2009. “seL4: Formal
Verification of an OS Kernel.” Proceedings of
the 22nd ACM Symposium on Operating Systems Principles (SOSP),
207–20. https://doi.org/10.1145/1629575.1629596.
Kletz, Trevor, and Paul Amyotte. 2010. Process Plants: A Handbook
for Inherently Safer Design. 2nd ed. CRC Press.
Knight, John C., and Nancy G. Leveson. 1986. “An Experimental
Evaluation of the Assumption of Independence in Multiversion
Programming.” IEEE Transactions on Software Engineering
SE-12 (1): 96–109.
Koopman, Philip, and Michael Wagner. 2016. “Challenges in
Autonomous Vehicle Testing and Validation.” SAE International
Journal of Transportation Safety 4 (1): 15–24. https://doi.org/10.4271/2016-01-0128.
Lamport, Leslie, Robert Shostak, and Marshall Pease. 1982. “The
Byzantine Generals Problem.” ACM Transactions on
Programming Languages and Systems 4 (3): 382–401. https://doi.org/10.1145/357172.357176.
Leveson, Nancy G. 2011. Engineering a Safer World: Systems Thinking
Applied to Safety. MIT Press. https://doi.org/10.7551/mitpress/8179.001.0001.
Leveson, Nancy G., and John P. Thomas. 2018. STPA
Handbook. MIT Partnership for Systems Approaches to Safety;
Security.
Leveson, Nancy G., and Clark S. Turner. 1993. “An Investigation of
the Therac-25 Accidents.” Computer 26 (7):
18–41. https://doi.org/10.1109/MC.1993.274940.
Lions, Jacques-Louis. 1996. ARIANE 5 Flight 501
Failure: Report by the Inquiry Board. European Space Agency.
Littlewood, Bev, and Lorenzo Strigini. 1993. “Validation of
Ultrahigh Dependability for Software-Based Systems.”
Communications of the ACM 36 (11): 69–80. https://doi.org/10.1145/163359.163373.
Lundteigen, Mary Ann, and Marvin Rausand. 2009. “Architectural
Constraints in IEC 61508: Do They Have the Intended
Effect?” Reliability Engineering & System Safety 94
(2): 520–25. https://doi.org/10.1016/j.ress.2008.06.003.
Lutz, Robyn R. 1993. “Analyzing Software Requirements Errors in
Safety-Critical, Embedded Systems.” Proceedings of the IEEE
International Symposium on Requirements Engineering, 126–33.
Meeker, William Q., and Luis A. Escobar. 1998. Statistical Methods
for Reliability Data. Wiley.
MISRA. 2025. MISRA C:2025 – Guidelines for the Use of
the C Language in Critical Systems. The MISRA
Consortium.
Modarres, Mohammad, Mark P. Kaminskiy, and Vasiliy Krivtsov. 2016.
Reliability Engineering and Risk Analysis: A Practical Guide.
3rd ed. CRC Press.
Mosleh, Ali, Karl N. Fleming, Gareth W. Parry, Henrique M. Paula, David
H. Worledge, and Dale M. Rasmuson. 1988. Procedures for Treating
Common Cause Failures in Safety and Reliability Studies.
NUREG/CR-4780. U.S. Nuclear Regulatory Commission.
National Transportation Safety Board. 2019. Collision Between
Vehicle Controlled by Developmental Automated Driving System and
Pedestrian, Tempe, Arizona, March 18,
2018. NTSB/HAR-19/03. NTSB.
Newcombe, Chris, Tim Rath, Fan Zhang, Bogdan Munteanu, Marc Brooker, and
Michael Deardeuff. 2015. “How Amazon Web Services
Uses Formal Methods.” Communications of the ACM 58 (4):
66–73. https://doi.org/10.1145/2699417.
Parasuraman, Raja, Thomas B. Sheridan, and Christopher D. Wickens. 2000.
“A Model for Types and Levels of Human Interaction with
Automation.” IEEE Transactions on Systems, Man, and
Cybernetics – Part A 30 (3): 286–97. https://doi.org/10.1109/3468.844354.
Perrow, Charles. 1984. Normal Accidents: Living with High-Risk
Technologies. Basic Books.
Rasmussen, Jens. 1983. “Skills, Rules, and Knowledge; Signals,
Signs, and Symbols, and Other Distinctions in Human Performance
Models.” IEEE Transactions on Systems, Man, and
Cybernetics SMC-13 (3): 257–66. https://doi.org/10.1109/TSMC.1983.6313160.
Rasmussen, Jens. 1997. “Risk Management in a Dynamic Society: A
Modelling Problem.” Safety Science 27 (2–3): 183–213. https://doi.org/10.1016/S0925-7535(97)00052-0.
Rausand, Marvin. 2014. Reliability of Safety-Critical Systems:
Theory and Applications. Wiley. https://doi.org/10.1002/9781118776353.
Rausand, Marvin, Anne Barros, and Arnljot Høyland. 2020. System
Reliability Theory: Models, Statistical Methods, and Applications.
3rd ed. Wiley. https://doi.org/10.1002/9781119373940.
Rauzy, Antoine. 1993. “New Algorithms for Fault Trees
Analysis.” Reliability Engineering & System Safety
40 (3): 203–11. https://doi.org/10.1016/0951-8320(93)90060-C.
Reason, James. 1990. Human Error. Cambridge University Press.
Reason, James. 1997. Managing the Risks of Organizational
Accidents. Ashgate.
RTCA. 2011a. DO-178C: Software Considerations in
Airborne Systems and Equipment Certification.
RTCA. 2011b. DO-333: Formal Methods Supplement to
DO-178C and DO-278A.
Ruijters, Enno, and Mariëlle Stoelinga. 2015. “Fault Tree
Analysis: A Survey of the State-of-the-Art in Modeling, Analysis and
Tools.” Computer Science Review 15–16: 29–62. https://doi.org/10.1016/j.cosrev.2015.03.001.
SAE International. 2021. J3016: Taxonomy and
Definitions for Terms Related to Driving Automation Systems for on-Road
Motor Vehicles.
SAE International. 2023a. ARP4754B: Guidelines for
Development of Civil Aircraft and Systems. https://doi.org/10.4271/ARP4754B.
SAE International. 2023b. ARP4761A: Guidelines for
Conducting the Safety Assessment Process on Civil Aircraft, Systems, and
Equipment.
Salay, Rick, Rodrigo Queiroz, and Krzysztof Czarnecki. 2017. An
Analysis of ISO 26262: Using Machine Learning Safely in
Automotive Software. arXiv:1709.02435.
Sha, Lui. 2001. “Using Simplicity to Control Complexity.”
IEEE Software 18 (4): 20–28. https://doi.org/10.1109/MS.2001.936213.
Smith, David J., and Kenneth G. L. Simpson. 2020. The Safety
Critical Systems Handbook: A Straightforward Guide to Functional
Safety. 5th ed. Butterworth-Heinemann.
Stamatelatos, Michael, William Vesely, Joanne Dugan, Joseph Fragola,
Joseph Minarick, and Jan Railsback. 2002. Fault Tree Handbook with
Aerospace Applications. Version 1.1. NASA Office of Safety; Mission
Assurance.
Swain, Alan D., and Henry E. Guttmann. 1983. Handbook of Human
Reliability Analysis with Emphasis on Nuclear Power Plant
Applications. NUREG/CR-1278. U.S. Nuclear Regulatory Commission.
Szegedy, Christian, Wojciech Zaremba, Ilya Sutskever, et al. 2014.
“Intriguing Properties of Neural Networks.”
International Conference on Learning Representations (ICLR).
Traverse, Pascal, Isabelle Lacaze, and Jean Souyris. 2004. “Airbus
Fly-by-Wire: A Total Approach to Dependability.” In Building
the Information Society (IFIP 18th World Computer Congress).
Springer.
Trivedi, Kishor S., and Andrea Bobbio. 2017. Reliability and
Availability Engineering: Modeling, Analysis, and Applications.
Cambridge University Press. https://doi.org/10.1017/9781316163047.
UL Standards & Engagement. 2023. UL 4600: Standard
for Evaluation of Autonomous Products. 3rd ed.
UNECE. 2016. UN Regulation No. 13: Uniform Provisions
Concerning the Approval of Vehicles of Categories M,
N and O with Regard to Braking.
UNECE. 2021a. UN Regulation No. 155: Cyber Security and
Cyber Security Management System.
UNECE. 2021b. UN Regulation No. 157: Automated Lane
Keeping Systems (ALKS).
U.S. Chemical Safety and Hazard Investigation Board. 2007.
Investigation Report: Refinery Explosion and Fire, BP
Texas City, Texas, March 23, 2005.
2005-04-I-TX. CSB.
U.S. Department of Defense. 2012. MIL-STD-882E:
Standard Practice – System Safety.
U.S. Nuclear Regulatory Commission. 1975. Reactor Safety Study: An
Assessment of Accident Risks in U.S. Commercial Nuclear
Power Plants. WASH-1400 (NUREG-75/014). U.S. Nuclear Regulatory
Commission.
Vesely, William E., Francine F. Goldberg, Norman H. Roberts, and David
F. Haasl. 1981. Fault Tree Handbook. NUREG-0492. U.S. Nuclear
Regulatory Commission.
Weibull, Waloddi. 1951. “A Statistical Distribution Function of
Wide Applicability.” Journal of Applied Mechanics 18:
293–97.
Williams, Jeremy C. 1988. “A Data-Based Method for Assessing and
Reducing Human Error to Improve Operational Performance.”
Proceedings of the IEEE Fourth Conference on Human Factors and Power
Plants (Monterey, CA), 436–50.
Yeh, Y. C. 1996. “Triple-Triple Redundant 777 Primary Flight
Computer.” Proceedings of the IEEE Aerospace Applications
Conference 1: 293–307.
Young, William, and Nancy G. Leveson. 2014. “An Integrated
Approach to Safety and Security Based on Systems Theory.”
Communications of the ACM 57 (2): 31–35. https://doi.org/10.1145/2556938.