Orna Raz

Most-cited papers

Semantic anomaly detection in online data sources
Orna Raz, Philip Koopman, M. Shaw
2002Proceedings of the 24th International Conference on Software Engineering. ICSE 2002126 citations
Semantic Scholar
Automatically detecting data drift in machine learning classifiers
Samuel Ackerman, Orna Raz, Marcel Zalmanovici, Aviad Zlotnick
2021arXiv.org49 citations
Semantic Scholar
Detection of data drift and outliers affecting machine learning model performance over time
Samuel Ackerman, E. Farchi, Orna Raz, Marcel Zalmanovici +1 more
2020arXiv.org49 citations
Semantic Scholar
Unveiling Safety Vulnerabilities of Large Language Models
George Kour, Marcel Zalmanovici, Naama Zwerdling, Esther Goldbraich +4 more
2023IEEE Games Entertainment Media Conference40 citations
Semantic Scholar
Predicting Question-Answering Performance of Large Language Models through Semantic Consistency
Ella Rabinovich, Samuel Ackerman, Orna Raz, E. Farchi +1 more
2023IEEE Games Entertainment Media Conference38 citations
Semantic Scholar
The Potential of Portfolio Analysis in Guiding Software Decisions
Shawn A. Butler, Prasad Chalasani, S. Jha, Orna Raz +1 more
199933 citations
Semantic Scholar
Bridging the gap between ML solutions and their business requirements using feature interactions
Guy Barash, E. Farchi, Ilan Jayaraman, Orna Raz +2 more
2019ESEC/SIGSOFT FSE28 citations
Semantic Scholar
Enabling automatic adaptation in systems with under-specified elements
Orna Raz, Philip Koopman, M. Shaw
2002Workshop on Self-Healing Systems23 citations Open access
Semantic Scholar
An approach to preserving sufficient correctness in open resource coalitions
Orna Raz, M. Shaw
2000Tenth International Workshop on Software Specification and Design. IWSSD-10 200023 citations Open access
Semantic Scholar
DETECTING SEMANTIC ANOMALIES IN TRUCK WEIGH-IN-MOTION TRAFFIC DATA USING DATA MINING
Orna Raz, R. B. Buchheit, M. Shaw, Philip Koopman +1 more
200422 citations Open access
Semantic Scholar
Alignment Studio: Aligning Large Language Models to Particular Contextual Regulations
Swapnaja Achintalwar, Ioana Baldini, Djallel Bouneffouf, Joan Byamugisha +15 more
2024IEEE Internet Computing18 citations Open access
Semantic Scholar
FreaAI: Automated extraction of data slices to test machine learning models
Samuel Ackerman, Orna Raz, Marcel Zalmanovici
2021Communications in Computer and Information Science18 citations Open access
Semantic Scholar
Automatic Generation of Benchmarks and Reliable LLM Judgment for Code Tasks
E. Farchi, Shmulik Froimovich, Rami Katan, Orna Raz
2024arXiv.org17 citations
Semantic Scholar
Machine Learning Model Drift Detection Via Weak Data Slices
Samuel Ackerman, Parijat Dube, E. Farchi, Orna Raz +1 more
2021Workshop on Deep Learning for Testing and Testing for Deep Learning17 citations Open access
Semantic Scholar
Detectors for Safe and Reliable LLMs: Implementations, Uses, and Limitations
Swapnaja Achintalwar, A. Garcia, Ateret Anaby-Tavor, Ioana Baldini +31 more
2024arXiv.org16 citations
Semantic Scholar
Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora
George Kour, Samuel Ackerman, E. Farchi, Orna Raz +2 more
2022IEEE Games Entertainment Media Conference16 citations Open access
Semantic Scholar
Testing of data‐centric and event‐based dynamic service compositions
Waldemar Hummer, Orna Raz, O. Shehory, P. Leitner +1 more
2013Software testing, verification & reliability14 citations
Semantic Scholar
Test Coverage of Data-Centric Dynamic Compositions in Service-Based Systems
Waldemar Hummer, Orna Raz, O. Shehory, P. Leitner +1 more
20112011 Fourth IEEE International Conference on Software Testing, Verification and Validation14 citations
Semantic Scholar
Software Risk Management and Insurance
Orna Raz, M. Shaw
200113 citations
Semantic Scholar
Code coverage analysis in practice for large systems
Yoram Adler, N. Behar, Orna Raz, O. Shehory +3 more
2011International Conference on Software Engineering12 citations
Semantic Scholar
Advanced code coverage analysis using substring holes
Yoram Adler, E. Farchi, M. Klausner, D. Pelleg +4 more
2009International Symposium on Software Testing and Analysis9 citations Open access
Semantic Scholar
Cluster-based test suite functional analysis
Marcel Zalmanovici, Orna Raz, Rachel Tzoref-Brill
2016SIGSOFT FSE7 citations
Semantic Scholar
Automated Validation of LLM-based Evaluators for Software Engineering Artifacts
Ora Nova Fandina, E. Farchi, Shmulik Froimovich, Rami Katan +3 more
2025arXiv.org6 citations
Semantic Scholar
Automated substring hole analysis
Yoram Adler, E. Farchi, M. Klausner, D. Pelleg +4 more
2009International Conference on Software Engineering6 citations Open access
Semantic Scholar
An effective method for keeping design artifacts up-to-date
Yochai Ben-Chaim, E. Farchi, Orna Raz
20092009 ICSE Workshop on Wikis for Software Engineering5 citations
Semantic Scholar
Automated Assistance for Eliciting User Expectations
Orna Raz, R. B. Buchheit, M. Shaw, Philip Koopman +1 more
2004International Conference on Software Engineering and Knowledge Engineering5 citations
Semantic Scholar
Theory and Practice of Quality Assurance for Machine Learning Systems: An Experiment-Driven Approach
Samuel Ackerman, Guy Barash, E. Farchi, Orna Raz +1 more
20224 citations
Semantic Scholar
Density-based interpretable hypercube region partitioning for mixed numeric and categorical data
Samuel Ackerman, E. Farchi, Orna Raz, Marcel Zalmanovici +1 more
2021arXiv.org4 citations
Semantic Scholar
Detecting model drift using polynomial relations
E. Roffe, Samuel Ackerman, Orna Raz, E. Farchi
2021arXiv.org4 citations
Semantic Scholar
Statistical multi-metric evaluation and visualization of LLM system predictive performance
Samuel Ackerman, E. Farchi, Orna Raz, Assaf Toledo
2025arXiv.org3 citations
Semantic Scholar
Towards efficient measuring of web services API coverage
Waldemar Hummer, Orna Raz, S. Dustdar
2011Principles of Engineering Service-Oriented Systems3 citations
Semantic Scholar
SeeCode - A Code Review Plug-in for Eclipse
M. Shochat, Orna Raz, E. Farchi
2009Haifa Verification Conference3 citations
Semantic Scholar
Helping everyday users find anomalies in data feeds
Orna Raz, M. Shaw
20043 citations
Semantic Scholar
Eliciting User Expectations for Data Behavior via Invariant Templates
Orna Raz, R. B. Buchheit, M. Shaw, Philip Koopman +1 more
20033 citations
Semantic Scholar
Vintage Code, Modern Judges: Meta-Validation in Low Data Regimes
Ora Nova Fandina, Gal Amram, E. Farchi, Shmulik Froimovich +5 more
20252025 40th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW)2 citations Open access
Semantic Scholar
Classifier Data Quality: A Geometric Complexity Based Method for Automated Baseline And Insights Generation
George Kour, Marcel Zalmanovici, Orna Raz, Samuel Ackerman +1 more
2021arXiv.org2 citations
Semantic Scholar
Social Dimensions in the Novels of Barbara Pym, 1949-1963: The Writer as Hidden Observer
Orna Raz, John Brannigan
20072 citations
Semantic Scholar
Benchmarking Semantic Availability of Dynamic Data Feeds
Orna Raz, Philip Koopman, M. Shaw
20022 citations
Semantic Scholar
Uncovering Code Insights: Leveraging GitHub Artifacts for Deeper Code Understanding
Ziv Nevo, Orna Raz, K. Yorav
20252025 40th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW)1 citations Open access
Semantic Scholar
Using Combinatorial Optimization to Design a High quality LLM Solution
Samuel Ackerman, E. Farchi, Rami Katan, Orna Raz
2024arXiv.org1 citations
Semantic Scholar
How Safe is Your Safety Metric? Automatic Concatenation Tests for Metric Reliability
Ora Nova Fandina, Leshem Choshen, E. Farchi, George Kour +2 more
20241 citations
Semantic Scholar
High-quality Conversational Systems
Samuel Ackerman, Ateret Anaby-Tavor, E. Farchi, Esther Goldbraich +6 more
2022arXiv.org1 citations Open access
Semantic Scholar
Optimizing Hierarchical Classification with Adaptive Node Collapses
Sujan Perera, Orna Raz, R. Routray, Sheng-Hua Bao +1 more
2018AAAI Workshops1 citations
Semantic Scholar
Proactive and Pervasive Combinatorial Testing
Dale Blue, Orna Raz, Rachel Tzoref-Brill, Paul A. Wojciak +1 more
20172018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP)1 citations
Semantic Scholar
Hardware-less testing for RAS software
Aviad Zlotnick, Orna Raz
2009Annual Haifa Experimental Systems Conference1 citations
Semantic Scholar
The Advantages of Post-Link Code Coverage
Orna Raz, M. Klausner, Nitzan Peleg, Gadi Haber +5 more
2007Haifa Verification Conference1 citations
Semantic Scholar
Research abstract for semantic anomaly detection in dynamic data feeds with incomplete specifications
Orna Raz
2002Proceedings of the 24th International Conference on Software Engineering. ICSE 20021 citations
Semantic Scholar
Evaluating perturbation robustness of generative systems that use COBOL code inputs
Samuel Ackerman, Wesam Ibraheem, Orna Raz, Marcel Zalmanovici
2025Proceedings of the 1st International Workshop on AI for Software Quality Evaluation - Judgment, Metrics, Benchmarks, and Beyond0 citations Open access
Semantic Scholar
PACIFIC: a framework for generating benchmarks to check Precise Automatically Checked Instruction Following In Code
I. Dreyfuss, Antonio Abu Nassar, Samuel Ackerman, Axel Bendavid +4 more
2025Proceedings of the 1st International Workshop on AI for Software Quality Evaluation - Judgment, Metrics, Benchmarks, and Beyond0 citations Open access
Semantic Scholar
Generating Unseen Code Tests In Infinitum
Marcel Zalmanovici, Orna Raz, E. Farchi, Iftach Freund
2024arXiv.org0 citations
Semantic Scholar