BSI
Job Title: Test Scientist AI
Reports to: AI Operations Team Leader
Location: Home Based
Overview / Purpose Of The Position
Test Scientist AI (TS-AI) is part of the Artificial Intelligence Notified Body, AI Conformity Assessment model testing team. The position is for an experienced Engineer/Scientist in Artificial Intelligence Systems. The role is twofold:
- to participate in the conformity assessment process of AI models, in terms of testing and reporting regulatory compliance of AI models as part of the AI/ML conformity assessment process of AI NB.
- to support planning and developing of BSI AI/ML projects.
Additionally, the TS-ML will have to participate in shaping and updating tools and procedures relevant to the conformity assessment process. He/She will be supporting training needs on AI/ML for the AI NB team.
Responsibilities & Accountabilities
- Support Global Quality and Accreditation in maintenance of accreditation.
- Support Internal Training to develop and deliver training to ensure that the Regulatory Requirements and BSI’s QMS fully understood.
- Cooperating with Project Management team for appropriate allocation of technical assessments according to impartiality and competence.
- Support technical assessment process by providing guidance and solutions.
- Test with the use of appropriate tools AI models from multiple industries (e.g. Medical Devices, Robotics, Biometrics) and report for compliance with EU regulations for stand-alone or embedded SW using AI/ML.
- Provide advice and support on certifications in area of expertise that may have a regulatory challenge.
- Participate in client meetings to facilitate CE marking processes.
- Provide AI/ML expertise leadership and mentoring in areas of competence to AI NB personnel.
- Support AI/ML technical personnel in conformity assessment of AI/ML SW.
- Communicate and coordinate actions effectively during assessment process.
- Proactively identify areas of AI/ML application to BSI business and processes.
- Participate in internal BSI projects for developing & testing AI/ML tools for augmenting BSI’s assessment process.
- Participate in the procurement of AI testing tools.
- Recording of time on the BSI Time system.
- Provide feedback to Operation manager on issues such as procedures, workflows, client complaints.
Key Success / Performance Indicators
- Achievement – delivering results and creating value.
- Timely completion of assigned tasks / total assigned tasks.
- Number of test reviews peer reviewed with no observations/ Total completed test reviews.
- Number of business AI projects lead and participation/ Total number of AI business projects.
- Training completion/Assigned training.
- Planning and organising.
- Supporting internal procedures, training, and tools procurement.
- Building and retaining relationships.
- Team working.
Language Requirements
- Business English
- Dutch Language (Optional)
Person Specification
Essential Criteria (required to do the job)
Knowledge and Experience (e.g. Type, level)
- An understanding of BSI, its role and the approach of Regulatory Services to Conformity Assessment Activities and Certification for CE / UK marking.
- At least three (3) years’ post-graduate experience in AI/ML model development, either in a regulated industry or as part of funded research projects.
- Awareness of quality systems, philosophies and principles and internal auditing principles and practices.
- Awareness of AI regulations and released standards/guidance.
- Experience in at least two of the following areas:
- Inference (Fuzzy Logic)
- Expert systems (Symbolic Reasoning, Knowledge Representation)
- Convolutional Neural Networks (CNNs)
- Artificial Neural Networks & Deep Learning,
- Clustering/Classifier methods (K-Means, K-Medoids, Self-Organizing Map, Gaussian Mixture, Fuzzy c-Means, Logistic Regression, kNN, SVM, Naïve Bayes),
- Regression algorithms (Linear, Nonlinear, Gaussian Process, SVM Regression, Generalized Linear Model, Regression Tree),
- Supervised/Unsupervised learning
Skills And Abilities (e.g. Teamwork, IT, Communication, Relationships)
- Conceptual and analytical thinking, efficiency and results orientation.
- A team player good at relationship building internally and externally with authorities and clients and other stakeholders.
- Ability to handle personalized data based on GDPR framework.
Education / Qualifications (e.g. Technical)
- BSc/MSc degree or higher in a discipline relevant to AI/ML such as SW algorithm development, Robotics, Medical Devices SW, Biometrics or equivalent qualification.
Desirable Criteria
Knowledge and Experience (e.g. Type, level)
- Comprehensive knowledge of AI Regulations and related Guidance documents.
- At least three (3) years’ post-graduate experience in one of the following areas: product development in relevant industries (e.g., robotics, MD, IVD), SW development, AI models development-testing.
- Experience in relevant fields, i.e., Quality Management System processes and R&D – Product Development and Manufacturing processes, Risk management Process and Regulatory aspects of Device Certification/Registration.
- Hands on knowledge of AI/ML tools (e.g. Python, Matlab, Java-ML, SHARK, FuzzyEngine, FUNZY, pyfuzzy, TensorFlow, Amazon SageMaker, Google Cloud AI, Azure ML, PyTorch, Keras, Cafee, Torch)
- Awareness of SW lifecycle and risk analysis.
Skills And Abilities (e.g. Teamwork, IT, Communication, Relationships)
- Background of remote and multinational working environment is considered a strong benefit.
Education / Qualifications (e.g. Technical)
- Certification on AI/ML development tools or AI testing tools.
Our Excellence Behaviours: Client-centric, Agile, Collaborative. These three behaviours represent how we do things at BSI. They help us ensure that BSI is a great place to work and a highly successful business.
BSI is conducting face-to-face interviews where appropriate and possible. If you are invited to a face-to-face interview but feel more comfortable with conducting the interview virtually, please speak to a member of our recruitment team.
To apply for this job please visit wd3.myworkdaysite.com.