Nov 30 06:23:45 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'linux_bridge' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} Nov 30 06:23:45 user nova-compute[75021]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:23:45 user nova-compute[75021]: INFO nova.virt.driver [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Loading compute driver 'libvirt.LibvirtDriver' Nov 30 06:23:45 user nova-compute[75021]: INFO nova.compute.provider_config [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Acquiring lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Acquired lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Releasing lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Full set of CONF: {{(pid=75021) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ******************************************************************************** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Configuration options gathered from: {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ================================================================================ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] allow_resize_to_same_host = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] arq_binding_timeout = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] backdoor_port = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] backdoor_socket = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] block_device_allocate_retries = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] block_device_allocate_retries_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cert = self.pem {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute_driver = libvirt.LibvirtDriver {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute_monitors = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] config_dir = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] config_drive_format = iso9660 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] config_file = ['/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] config_source = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] console_host = user {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] control_exchange = nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cpu_allocation_ratio = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] daemon = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] debug = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_access_ip_network_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_availability_zone = nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_ephemeral_format = ext4 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_green_pool_size = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] default_schedule_zone = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] disk_allocation_ratio = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] enable_new_services = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] enabled_apis = ['osapi_compute'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] enabled_ssl_apis = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] flat_injected = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] force_config_drive = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] force_raw_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] graceful_shutdown_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] heal_instance_info_cache_interval = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] host = user {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] initial_disk_allocation_ratio = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] initial_ram_allocation_ratio = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_build_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_delete_interval = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_format = [instance: %(uuid)s] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_name_template = instance-%08x {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_usage_audit = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_usage_audit_period = month {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] instances_path = /opt/stack/data/nova/instances {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] internal_service_availability_zone = internal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] key = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] live_migration_retry_count = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_config_append = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_dir = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_options = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_rotate_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_rotate_interval_type = days {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] log_rotation_type = none {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] long_rpc_timeout = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_concurrent_builds = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_concurrent_live_migrations = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_concurrent_snapshots = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_local_block_devices = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_logfile_count = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] max_logfile_size_mb = 200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] maximum_instance_delete_attempts = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metadata_listen = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metadata_listen_port = 8775 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metadata_workers = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] migrate_max_retries = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] mkisofs_cmd = genisoimage {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] my_block_storage_ip = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] my_ip = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] network_allocate_retries = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] osapi_compute_listen = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] osapi_compute_listen_port = 8774 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] osapi_compute_unique_server_name_scope = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] osapi_compute_workers = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] password_length = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] periodic_enable = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] periodic_fuzzy_delay = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] pointer_model = ps2mouse {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] preallocate_images = none {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] publish_errors = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] pybasedir = /opt/stack/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ram_allocation_ratio = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rate_limit_burst = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rate_limit_except_level = CRITICAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rate_limit_interval = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reboot_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reclaim_instance_interval = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] record = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reimage_timeout_per_gb = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] report_interval = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rescue_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reserved_host_cpus = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reserved_host_disk_mb = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reserved_host_memory_mb = 512 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] reserved_huge_pages = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] resize_confirm_window = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] resize_fs_using_block_device = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] resume_guests_state_on_host_boot = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rpc_response_timeout = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] run_external_periodic_tasks = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] running_deleted_instance_action = reap {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] running_deleted_instance_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler_instance_sync_interval = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_down_time = 720 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] servicegroup_driver = db {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] shelved_offload_time = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] shelved_poll_interval = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] shutdown_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] source_is_ipv6 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ssl_only = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] state_path = /opt/stack/data/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] sync_power_state_interval = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] sync_power_state_pool_size = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] syslog_log_facility = LOG_USER {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] tempdir = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] timeout_nbd = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] transport_url = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] update_resources_interval = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_cow_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_eventlog = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_journal = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_json = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_rootwrap_daemon = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_stderr = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] use_syslog = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vcpu_pin_set = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plugging_is_fatal = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plugging_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] virt_mkfs = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] volume_usage_poll_interval = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] watch_log_file = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] web = /usr/share/spice-html5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.auth_strategy = keystone {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.compute_link_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.dhcp_domain = novalocal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.enable_instance_password = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.glance_link_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.instance_list_per_project_cells = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.list_records_by_skipping_down_cells = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.local_metadata_per_cell = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.max_limit = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.metadata_cache_expiration = 15 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.neutron_default_tenant_id = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.use_forwarded_for = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.use_neutron_default_nets = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_dynamic_targets = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_jsonfile_path = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.backend = dogpile.cache.memcached {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.backend_argument = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.config_prefix = cache.oslo {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.dead_timeout = 60.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.debug_cache_backend = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.enable_retry_client = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.enable_socket_keepalive = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.enabled = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.expiration_time = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_dead_retry = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_password = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_sasl_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.memcache_username = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.proxies = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.retry_attempts = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.retry_delay = 0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.socket_keepalive_count = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.socket_keepalive_idle = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.socket_keepalive_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.tls_allowed_ciphers = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.tls_cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.tls_certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.tls_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cache.tls_keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.auth_type = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.catalog_info = volumev3::publicURL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.cross_az_attach = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.debug = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.endpoint_template = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.http_retries = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.os_region_name = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cinder.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.cpu_dedicated_set = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.cpu_shared_set = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.image_type_exclude_list = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.resource_provider_association_refresh = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.shutdown_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] conductor.workers = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] console.allowed_origins = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] console.ssl_ciphers = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] console.ssl_minimum_version = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] consoleauth.token_ttl = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.service_type = accelerator {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] cyborg.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.backend = sqlalchemy {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.connection = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.connection_debug = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.connection_parameters = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.connection_recycle_time = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.connection_trace = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.db_inc_retry_interval = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.db_max_retries = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.db_max_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.db_retry_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.max_overflow = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.max_pool_size = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.max_retries = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.pool_timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.slave_connection = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] database.sqlite_synchronous = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.backend = sqlalchemy {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.connection = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.connection_debug = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.connection_parameters = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.connection_recycle_time = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.connection_trace = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.db_inc_retry_interval = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.db_max_retries = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.db_max_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.db_retry_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.max_overflow = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.max_pool_size = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.max_retries = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.pool_timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.slave_connection = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] api_database.sqlite_synchronous = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] devices.enabled_mdev_types = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ephemeral_storage_encryption.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.api_servers = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.debug = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.default_trusted_certificate_ids = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.enable_certificate_validation = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.enable_rbd_download = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.num_retries = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.rbd_ceph_conf = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.rbd_connect_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.rbd_pool = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.rbd_user = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.service_type = image {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.verify_glance_signatures = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] glance.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] guestfs.debug = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.config_drive_cdrom = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.config_drive_inject_password = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.enable_remotefx = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.instances_path_share = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.iscsi_initiator_list = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.limit_cpu_features = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.use_multipath_io = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.vswitch_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] mks.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.manager_interval = 2400 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.precache_concurrency = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.remove_unused_base_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] image_cache.subdirectory_name = _base {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.api_max_retries = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.api_retry_interval = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.conductor_group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.peer_list = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.serial_console_state_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.service_type = baremetal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ironic.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] key_manager.fixed_key = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.barbican_api_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.barbican_endpoint = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.barbican_endpoint_type = public {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.barbican_region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.number_of_retries = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.retry_delay = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.send_service_user_token = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.verify_ssl = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican.verify_ssl_path = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] barbican_service_user.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.approle_role_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.approle_secret_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.kv_mountpoint = secret {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.kv_path = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.kv_version = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.namespace = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.root_token_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.ssl_ca_crt_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.use_ssl = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.service_type = identity {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] keystone.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.connection_uri = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_mode = custom {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_model_extra_flags = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: WARNING oslo_config.cfg [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_models = ['Nehalem'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_power_governor_high = performance {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_power_management = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.device_detach_attempts = 8 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.device_detach_timeout = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.disk_cachemodes = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.disk_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.enabled_perf_events = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.file_backed_memory = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.gid_maps = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.hw_disk_discard = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.hw_machine_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_rbd_ceph_conf = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_rbd_glance_store_name = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_rbd_pool = rbd {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_type = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.images_volume_group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.inject_key = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.inject_partition = -2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.inject_password = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.iscsi_iface = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.iser_use_multipath = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_downtime = 500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_inbound_addr = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_scheme = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_timeout_action = abort {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_tunnelled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: WARNING oslo_config.cfg [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 30 06:23:45 user nova-compute[75021]: live_migration_uri is deprecated for removal in favor of two other options that Nov 30 06:23:45 user nova-compute[75021]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 30 06:23:45 user nova-compute[75021]: and ``live_migration_inbound_addr`` respectively. Nov 30 06:23:45 user nova-compute[75021]: ). Its value may be silently ignored in the future. Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.live_migration_with_native_tls = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.max_queues = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.nfs_mount_options = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_iser_scan_tries = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_pcie_ports = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.num_volume_scan_tries = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.pmem_namespaces = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.quobyte_client_cfg = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rbd_connect_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rbd_secret_uuid = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rbd_user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rescue_image_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rescue_kernel_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rescue_ramdisk_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.rx_queue_size = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.smbfs_mount_options = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.snapshot_compression = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.snapshot_image_format = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.sparse_logical_volumes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.swtpm_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.swtpm_group = tss {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.swtpm_user = tss {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.sysinfo_serial = unique {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.tb_cache_size = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.tx_queue_size = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.uid_maps = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.use_virtio_for_bridges = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.virt_type = kvm {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.volume_clear = zero {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.volume_clear_size = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.volume_use_multipath = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_cache_path = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_mount_group = qemu {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_mount_opts = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.vzstorage_mount_user = stack {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.auth_type = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.default_floating_pool = public {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.extension_sync_interval = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.http_retries = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.ovs_bridge = br-int {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.physnets = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.region_name = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.service_metadata_proxy = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.service_type = network {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] neutron.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] notifications.bdms_in_notifications = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] notifications.default_level = INFO {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] notifications.notification_format = unversioned {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] notifications.notify_on_state_change = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] pci.alias = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] pci.device_spec = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] pci.report_in_placement = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.auth_type = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.auth_url = http://10.0.0.210/identity {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.default_domain_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.default_domain_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.domain_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.domain_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.password = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.project_domain_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.project_domain_name = Default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.project_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.project_name = service {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.region_name = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.service_type = placement {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.system_scope = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.trust_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.user_domain_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.user_domain_name = Default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.user_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.username = placement {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] placement.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.cores = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.count_usage_from_placement = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.injected_file_content_bytes = 10240 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.injected_file_path_length = 255 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.injected_files = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.instances = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.key_pairs = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.metadata_items = 128 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.ram = 51200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.recheck_quota = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.server_group_members = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] quota.server_groups = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rdp.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.image_metadata_prefilter = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.max_attempts = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.max_placement_results = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] scheduler.workers = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.host_subset_size = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.isolated_hosts = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.isolated_images = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.pci_in_placement = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.track_instance_changes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metrics.required = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metrics.weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] metrics.weight_setting = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.port_range = 10000:20000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] serial_console.serialproxy_port = 6083 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.auth_type = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.send_service_user_token = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] service_user.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.agent_enabled = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.html5proxy_base_url = http://10.0.0.210:6081/spice_auto.html {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.html5proxy_port = 6082 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.image_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.jpeg_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.playback_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.server_listen = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.streaming_mode = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] spice.zlib_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] upgrade_levels.baseapi = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] upgrade_levels.compute = auto {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] upgrade_levels.conductor = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] upgrade_levels.scheduler = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vendordata_dynamic_auth.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.api_retry_count = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.ca_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.cache_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.cluster_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.connection_pool_size = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.console_delay_seconds = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.datastore_regex = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.host_ip = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.host_password = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.host_port = 443 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.host_username = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.integration_bridge = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.maximum_objects = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.pbm_default_policy = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.pbm_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.pbm_wsdl_location = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.serial_port_proxy_uri = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.serial_port_service_uri = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.task_poll_interval = 0.5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.use_linked_clone = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.vnc_keymap = en-us {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.vnc_port = 5900 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vmware.vnc_port_total = 10000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.auth_schemes = ['none'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.enabled = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.novncproxy_base_url = http://10.0.0.210:6080/vnc_lite.html {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.novncproxy_port = 6080 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.server_listen = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.vencrypt_ca_certs = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.vencrypt_client_cert = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vnc.vencrypt_client_key = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.disable_rootwrap = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.enable_numa_live_migration = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.libvirt_disable_apic = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.client_socket_timeout = 900 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.default_pool_size = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.keep_alive = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.max_header_line = 16384 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.secure_proxy_ssl_header = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.ssl_ca_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.ssl_cert_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.ssl_key_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.tcp_keepidle = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] zvm.ca_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] zvm.cloud_connector_url = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] zvm.reachable_timeout = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.enforce_scope = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.policy_default_rule = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.connection_string = messaging:// {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.es_doc_type = notification {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.es_scroll_size = 10000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.es_scroll_time = 2m {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.filter_error_trace = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.hmac_keys = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.sentinel_service_name = mymaster {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.socket_timeout = 0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.trace_requests = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler.trace_sqlalchemy = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler_jaeger.process_tags = {} {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] profiler_otlp.service_name_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] remote_debug.host = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] remote_debug.port = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.connect_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.endpoint_id = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.endpoint_override = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.max_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.min_version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.region_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.service_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.service_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.valid_interfaces = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_limit.version = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_reports.file_event_handler = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] oslo_reports.log_dir = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] vif_plug_ovs_privileged.user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.iptables_bottom_regex = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.iptables_top_regex = {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.use_ipv6 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.default_qos_type = linux-noop {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.isolate_vif = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.network_device_mtu = 1500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.ovs_vsctl_timeout = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.ovsdb_interface = native {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_vif_ovs.per_port_bridge = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] os_brick.lock_path = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.capabilities = [21] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] privsep_osbrick.user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] nova_sys_admin.user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG oslo_service.service [None req-ceb4c0d8-198d-40db-aec4-478afd7712d4 None None] ******************************************************************************** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 30 06:23:45 user nova-compute[75021]: INFO nova.service [-] Starting compute node (version 0.0.0) Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Connecting to libvirt: qemu:///system {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Registering for lifecycle events {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}} Nov 30 06:23:45 user nova-compute[75021]: libvirt: error : internal error: could not initialize domain event timer Nov 30 06:23:45 user nova-compute[75021]: WARNING nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Registering for connection events: {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Starting native event thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Starting green dispatch thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}} Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Starting connection event dispatch thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}} Nov 30 06:23:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Connection event '1' reason 'None' Nov 30 06:23:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found. Nov 30 06:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.mount [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Initialising _HostMountState generation 0 {{(pid=75021) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Nov 30 06:23:53 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host capabilities Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: e20c3142-5af9-7467-ecd8-70b2e4a210d6 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: x86_64 Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tcp Nov 30 06:23:53 user nova-compute[75021]: rdma Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 8189224 Nov 30 06:23:53 user nova-compute[75021]: 2047306 Nov 30 06:23:53 user nova-compute[75021]: 0 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 8206460 Nov 30 06:23:53 user nova-compute[75021]: 2051615 Nov 30 06:23:53 user nova-compute[75021]: 0 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: apparmor Nov 30 06:23:53 user nova-compute[75021]: 0 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: dac Nov 30 06:23:53 user nova-compute[75021]: 0 Nov 30 06:23:53 user nova-compute[75021]: +64055:+108 Nov 30 06:23:53 user nova-compute[75021]: +64055:+108 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-alpha Nov 30 06:23:53 user nova-compute[75021]: clipper Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-arm Nov 30 06:23:53 user nova-compute[75021]: integratorcp Nov 30 06:23:53 user nova-compute[75021]: ast2600-evb Nov 30 06:23:53 user nova-compute[75021]: borzoi Nov 30 06:23:53 user nova-compute[75021]: spitz Nov 30 06:23:53 user nova-compute[75021]: virt-2.7 Nov 30 06:23:53 user nova-compute[75021]: nuri Nov 30 06:23:53 user nova-compute[75021]: mcimx7d-sabre Nov 30 06:23:53 user nova-compute[75021]: romulus-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-3.0 Nov 30 06:23:53 user nova-compute[75021]: virt-5.0 Nov 30 06:23:53 user nova-compute[75021]: npcm750-evb Nov 30 06:23:53 user nova-compute[75021]: virt-2.10 Nov 30 06:23:53 user nova-compute[75021]: rainier-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an547 Nov 30 06:23:53 user nova-compute[75021]: musca-b1 Nov 30 06:23:53 user nova-compute[75021]: realview-pbx-a9 Nov 30 06:23:53 user nova-compute[75021]: versatileab Nov 30 06:23:53 user nova-compute[75021]: kzm Nov 30 06:23:53 user nova-compute[75021]: virt-2.8 Nov 30 06:23:53 user nova-compute[75021]: musca-a Nov 30 06:23:53 user nova-compute[75021]: virt-3.1 Nov 30 06:23:53 user nova-compute[75021]: mcimx6ul-evk Nov 30 06:23:53 user nova-compute[75021]: virt-5.1 Nov 30 06:23:53 user nova-compute[75021]: smdkc210 Nov 30 06:23:53 user nova-compute[75021]: sx1 Nov 30 06:23:53 user nova-compute[75021]: virt-2.11 Nov 30 06:23:53 user nova-compute[75021]: imx25-pdk Nov 30 06:23:53 user nova-compute[75021]: stm32vldiscovery Nov 30 06:23:53 user nova-compute[75021]: virt-2.9 Nov 30 06:23:53 user nova-compute[75021]: orangepi-pc Nov 30 06:23:53 user nova-compute[75021]: quanta-q71l-bmc Nov 30 06:23:53 user nova-compute[75021]: z2 Nov 30 06:23:53 user nova-compute[75021]: virt-5.2 Nov 30 06:23:53 user nova-compute[75021]: xilinx-zynq-a9 Nov 30 06:23:53 user nova-compute[75021]: tosa Nov 30 06:23:53 user nova-compute[75021]: mps2-an500 Nov 30 06:23:53 user nova-compute[75021]: virt-2.12 Nov 30 06:23:53 user nova-compute[75021]: mps2-an521 Nov 30 06:23:53 user nova-compute[75021]: sabrelite Nov 30 06:23:53 user nova-compute[75021]: mps2-an511 Nov 30 06:23:53 user nova-compute[75021]: canon-a1100 Nov 30 06:23:53 user nova-compute[75021]: realview-eb Nov 30 06:23:53 user nova-compute[75021]: quanta-gbs-bmc Nov 30 06:23:53 user nova-compute[75021]: emcraft-sf2 Nov 30 06:23:53 user nova-compute[75021]: realview-pb-a8 Nov 30 06:23:53 user nova-compute[75021]: virt-4.0 Nov 30 06:23:53 user nova-compute[75021]: raspi1ap Nov 30 06:23:53 user nova-compute[75021]: palmetto-bmc Nov 30 06:23:53 user nova-compute[75021]: sx1-v1 Nov 30 06:23:53 user nova-compute[75021]: n810 Nov 30 06:23:53 user nova-compute[75021]: g220a-bmc Nov 30 06:23:53 user nova-compute[75021]: n800 Nov 30 06:23:53 user nova-compute[75021]: tacoma-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.1 Nov 30 06:23:53 user nova-compute[75021]: quanta-gsj Nov 30 06:23:53 user nova-compute[75021]: versatilepb Nov 30 06:23:53 user nova-compute[75021]: terrier Nov 30 06:23:53 user nova-compute[75021]: mainstone Nov 30 06:23:53 user nova-compute[75021]: realview-eb-mpcore Nov 30 06:23:53 user nova-compute[75021]: supermicrox11-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.2 Nov 30 06:23:53 user nova-compute[75021]: witherspoon-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an524 Nov 30 06:23:53 user nova-compute[75021]: swift-bmc Nov 30 06:23:53 user nova-compute[75021]: kudo-bmc Nov 30 06:23:53 user nova-compute[75021]: vexpress-a9 Nov 30 06:23:53 user nova-compute[75021]: midway Nov 30 06:23:53 user nova-compute[75021]: musicpal Nov 30 06:23:53 user nova-compute[75021]: lm3s811evb Nov 30 06:23:53 user nova-compute[75021]: lm3s6965evb Nov 30 06:23:53 user nova-compute[75021]: microbit Nov 30 06:23:53 user nova-compute[75021]: mps2-an505 Nov 30 06:23:53 user nova-compute[75021]: mps2-an385 Nov 30 06:23:53 user nova-compute[75021]: virt-6.0 Nov 30 06:23:53 user nova-compute[75021]: cubieboard Nov 30 06:23:53 user nova-compute[75021]: verdex Nov 30 06:23:53 user nova-compute[75021]: netduino2 Nov 30 06:23:53 user nova-compute[75021]: mps2-an386 Nov 30 06:23:53 user nova-compute[75021]: virt-6.1 Nov 30 06:23:53 user nova-compute[75021]: raspi2b Nov 30 06:23:53 user nova-compute[75021]: vexpress-a15 Nov 30 06:23:53 user nova-compute[75021]: fuji-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-6.2 Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: sonorapass-bmc Nov 30 06:23:53 user nova-compute[75021]: cheetah Nov 30 06:23:53 user nova-compute[75021]: virt-2.6 Nov 30 06:23:53 user nova-compute[75021]: ast2500-evb Nov 30 06:23:53 user nova-compute[75021]: highbank Nov 30 06:23:53 user nova-compute[75021]: akita Nov 30 06:23:53 user nova-compute[75021]: connex Nov 30 06:23:53 user nova-compute[75021]: netduinoplus2 Nov 30 06:23:53 user nova-compute[75021]: collie Nov 30 06:23:53 user nova-compute[75021]: raspi0 Nov 30 06:23:53 user nova-compute[75021]: fp5280g2-bmc Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-arm Nov 30 06:23:53 user nova-compute[75021]: integratorcp Nov 30 06:23:53 user nova-compute[75021]: ast2600-evb Nov 30 06:23:53 user nova-compute[75021]: borzoi Nov 30 06:23:53 user nova-compute[75021]: spitz Nov 30 06:23:53 user nova-compute[75021]: virt-2.7 Nov 30 06:23:53 user nova-compute[75021]: nuri Nov 30 06:23:53 user nova-compute[75021]: mcimx7d-sabre Nov 30 06:23:53 user nova-compute[75021]: romulus-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-3.0 Nov 30 06:23:53 user nova-compute[75021]: virt-5.0 Nov 30 06:23:53 user nova-compute[75021]: npcm750-evb Nov 30 06:23:53 user nova-compute[75021]: virt-2.10 Nov 30 06:23:53 user nova-compute[75021]: rainier-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an547 Nov 30 06:23:53 user nova-compute[75021]: musca-b1 Nov 30 06:23:53 user nova-compute[75021]: realview-pbx-a9 Nov 30 06:23:53 user nova-compute[75021]: versatileab Nov 30 06:23:53 user nova-compute[75021]: kzm Nov 30 06:23:53 user nova-compute[75021]: virt-2.8 Nov 30 06:23:53 user nova-compute[75021]: musca-a Nov 30 06:23:53 user nova-compute[75021]: virt-3.1 Nov 30 06:23:53 user nova-compute[75021]: mcimx6ul-evk Nov 30 06:23:53 user nova-compute[75021]: virt-5.1 Nov 30 06:23:53 user nova-compute[75021]: smdkc210 Nov 30 06:23:53 user nova-compute[75021]: sx1 Nov 30 06:23:53 user nova-compute[75021]: virt-2.11 Nov 30 06:23:53 user nova-compute[75021]: imx25-pdk Nov 30 06:23:53 user nova-compute[75021]: stm32vldiscovery Nov 30 06:23:53 user nova-compute[75021]: virt-2.9 Nov 30 06:23:53 user nova-compute[75021]: orangepi-pc Nov 30 06:23:53 user nova-compute[75021]: quanta-q71l-bmc Nov 30 06:23:53 user nova-compute[75021]: z2 Nov 30 06:23:53 user nova-compute[75021]: virt-5.2 Nov 30 06:23:53 user nova-compute[75021]: xilinx-zynq-a9 Nov 30 06:23:53 user nova-compute[75021]: tosa Nov 30 06:23:53 user nova-compute[75021]: mps2-an500 Nov 30 06:23:53 user nova-compute[75021]: virt-2.12 Nov 30 06:23:53 user nova-compute[75021]: mps2-an521 Nov 30 06:23:53 user nova-compute[75021]: sabrelite Nov 30 06:23:53 user nova-compute[75021]: mps2-an511 Nov 30 06:23:53 user nova-compute[75021]: canon-a1100 Nov 30 06:23:53 user nova-compute[75021]: realview-eb Nov 30 06:23:53 user nova-compute[75021]: quanta-gbs-bmc Nov 30 06:23:53 user nova-compute[75021]: emcraft-sf2 Nov 30 06:23:53 user nova-compute[75021]: realview-pb-a8 Nov 30 06:23:53 user nova-compute[75021]: virt-4.0 Nov 30 06:23:53 user nova-compute[75021]: raspi1ap Nov 30 06:23:53 user nova-compute[75021]: palmetto-bmc Nov 30 06:23:53 user nova-compute[75021]: sx1-v1 Nov 30 06:23:53 user nova-compute[75021]: n810 Nov 30 06:23:53 user nova-compute[75021]: g220a-bmc Nov 30 06:23:53 user nova-compute[75021]: n800 Nov 30 06:23:53 user nova-compute[75021]: tacoma-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.1 Nov 30 06:23:53 user nova-compute[75021]: quanta-gsj Nov 30 06:23:53 user nova-compute[75021]: versatilepb Nov 30 06:23:53 user nova-compute[75021]: terrier Nov 30 06:23:53 user nova-compute[75021]: mainstone Nov 30 06:23:53 user nova-compute[75021]: realview-eb-mpcore Nov 30 06:23:53 user nova-compute[75021]: supermicrox11-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.2 Nov 30 06:23:53 user nova-compute[75021]: witherspoon-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an524 Nov 30 06:23:53 user nova-compute[75021]: swift-bmc Nov 30 06:23:53 user nova-compute[75021]: kudo-bmc Nov 30 06:23:53 user nova-compute[75021]: vexpress-a9 Nov 30 06:23:53 user nova-compute[75021]: midway Nov 30 06:23:53 user nova-compute[75021]: musicpal Nov 30 06:23:53 user nova-compute[75021]: lm3s811evb Nov 30 06:23:53 user nova-compute[75021]: lm3s6965evb Nov 30 06:23:53 user nova-compute[75021]: microbit Nov 30 06:23:53 user nova-compute[75021]: mps2-an505 Nov 30 06:23:53 user nova-compute[75021]: mps2-an385 Nov 30 06:23:53 user nova-compute[75021]: virt-6.0 Nov 30 06:23:53 user nova-compute[75021]: cubieboard Nov 30 06:23:53 user nova-compute[75021]: verdex Nov 30 06:23:53 user nova-compute[75021]: netduino2 Nov 30 06:23:53 user nova-compute[75021]: mps2-an386 Nov 30 06:23:53 user nova-compute[75021]: virt-6.1 Nov 30 06:23:53 user nova-compute[75021]: raspi2b Nov 30 06:23:53 user nova-compute[75021]: vexpress-a15 Nov 30 06:23:53 user nova-compute[75021]: fuji-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-6.2 Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: sonorapass-bmc Nov 30 06:23:53 user nova-compute[75021]: cheetah Nov 30 06:23:53 user nova-compute[75021]: virt-2.6 Nov 30 06:23:53 user nova-compute[75021]: ast2500-evb Nov 30 06:23:53 user nova-compute[75021]: highbank Nov 30 06:23:53 user nova-compute[75021]: akita Nov 30 06:23:53 user nova-compute[75021]: connex Nov 30 06:23:53 user nova-compute[75021]: netduinoplus2 Nov 30 06:23:53 user nova-compute[75021]: collie Nov 30 06:23:53 user nova-compute[75021]: raspi0 Nov 30 06:23:53 user nova-compute[75021]: fp5280g2-bmc Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-aarch64 Nov 30 06:23:53 user nova-compute[75021]: integratorcp Nov 30 06:23:53 user nova-compute[75021]: ast2600-evb Nov 30 06:23:53 user nova-compute[75021]: borzoi Nov 30 06:23:53 user nova-compute[75021]: spitz Nov 30 06:23:53 user nova-compute[75021]: virt-2.7 Nov 30 06:23:53 user nova-compute[75021]: nuri Nov 30 06:23:53 user nova-compute[75021]: mcimx7d-sabre Nov 30 06:23:53 user nova-compute[75021]: romulus-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-3.0 Nov 30 06:23:53 user nova-compute[75021]: virt-5.0 Nov 30 06:23:53 user nova-compute[75021]: npcm750-evb Nov 30 06:23:53 user nova-compute[75021]: virt-2.10 Nov 30 06:23:53 user nova-compute[75021]: rainier-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an547 Nov 30 06:23:53 user nova-compute[75021]: virt-2.8 Nov 30 06:23:53 user nova-compute[75021]: musca-b1 Nov 30 06:23:53 user nova-compute[75021]: realview-pbx-a9 Nov 30 06:23:53 user nova-compute[75021]: versatileab Nov 30 06:23:53 user nova-compute[75021]: kzm Nov 30 06:23:53 user nova-compute[75021]: musca-a Nov 30 06:23:53 user nova-compute[75021]: virt-3.1 Nov 30 06:23:53 user nova-compute[75021]: mcimx6ul-evk Nov 30 06:23:53 user nova-compute[75021]: virt-5.1 Nov 30 06:23:53 user nova-compute[75021]: smdkc210 Nov 30 06:23:53 user nova-compute[75021]: sx1 Nov 30 06:23:53 user nova-compute[75021]: virt-2.11 Nov 30 06:23:53 user nova-compute[75021]: imx25-pdk Nov 30 06:23:53 user nova-compute[75021]: stm32vldiscovery Nov 30 06:23:53 user nova-compute[75021]: virt-2.9 Nov 30 06:23:53 user nova-compute[75021]: orangepi-pc Nov 30 06:23:53 user nova-compute[75021]: quanta-q71l-bmc Nov 30 06:23:53 user nova-compute[75021]: z2 Nov 30 06:23:53 user nova-compute[75021]: virt-5.2 Nov 30 06:23:53 user nova-compute[75021]: xilinx-zynq-a9 Nov 30 06:23:53 user nova-compute[75021]: xlnx-zcu102 Nov 30 06:23:53 user nova-compute[75021]: tosa Nov 30 06:23:53 user nova-compute[75021]: mps2-an500 Nov 30 06:23:53 user nova-compute[75021]: virt-2.12 Nov 30 06:23:53 user nova-compute[75021]: mps2-an521 Nov 30 06:23:53 user nova-compute[75021]: sabrelite Nov 30 06:23:53 user nova-compute[75021]: mps2-an511 Nov 30 06:23:53 user nova-compute[75021]: canon-a1100 Nov 30 06:23:53 user nova-compute[75021]: realview-eb Nov 30 06:23:53 user nova-compute[75021]: quanta-gbs-bmc Nov 30 06:23:53 user nova-compute[75021]: emcraft-sf2 Nov 30 06:23:53 user nova-compute[75021]: realview-pb-a8 Nov 30 06:23:53 user nova-compute[75021]: sbsa-ref Nov 30 06:23:53 user nova-compute[75021]: virt-4.0 Nov 30 06:23:53 user nova-compute[75021]: raspi1ap Nov 30 06:23:53 user nova-compute[75021]: palmetto-bmc Nov 30 06:23:53 user nova-compute[75021]: sx1-v1 Nov 30 06:23:53 user nova-compute[75021]: n810 Nov 30 06:23:53 user nova-compute[75021]: g220a-bmc Nov 30 06:23:53 user nova-compute[75021]: n800 Nov 30 06:23:53 user nova-compute[75021]: tacoma-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.1 Nov 30 06:23:53 user nova-compute[75021]: quanta-gsj Nov 30 06:23:53 user nova-compute[75021]: versatilepb Nov 30 06:23:53 user nova-compute[75021]: terrier Nov 30 06:23:53 user nova-compute[75021]: mainstone Nov 30 06:23:53 user nova-compute[75021]: realview-eb-mpcore Nov 30 06:23:53 user nova-compute[75021]: supermicrox11-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-4.2 Nov 30 06:23:53 user nova-compute[75021]: witherspoon-bmc Nov 30 06:23:53 user nova-compute[75021]: mps3-an524 Nov 30 06:23:53 user nova-compute[75021]: swift-bmc Nov 30 06:23:53 user nova-compute[75021]: kudo-bmc Nov 30 06:23:53 user nova-compute[75021]: vexpress-a9 Nov 30 06:23:53 user nova-compute[75021]: midway Nov 30 06:23:53 user nova-compute[75021]: musicpal Nov 30 06:23:53 user nova-compute[75021]: lm3s811evb Nov 30 06:23:53 user nova-compute[75021]: lm3s6965evb Nov 30 06:23:53 user nova-compute[75021]: microbit Nov 30 06:23:53 user nova-compute[75021]: mps2-an505 Nov 30 06:23:53 user nova-compute[75021]: mps2-an385 Nov 30 06:23:53 user nova-compute[75021]: virt-6.0 Nov 30 06:23:53 user nova-compute[75021]: raspi3ap Nov 30 06:23:53 user nova-compute[75021]: cubieboard Nov 30 06:23:53 user nova-compute[75021]: verdex Nov 30 06:23:53 user nova-compute[75021]: netduino2 Nov 30 06:23:53 user nova-compute[75021]: xlnx-versal-virt Nov 30 06:23:53 user nova-compute[75021]: mps2-an386 Nov 30 06:23:53 user nova-compute[75021]: virt-6.1 Nov 30 06:23:53 user nova-compute[75021]: raspi3b Nov 30 06:23:53 user nova-compute[75021]: raspi2b Nov 30 06:23:53 user nova-compute[75021]: vexpress-a15 Nov 30 06:23:53 user nova-compute[75021]: fuji-bmc Nov 30 06:23:53 user nova-compute[75021]: virt-6.2 Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: sonorapass-bmc Nov 30 06:23:53 user nova-compute[75021]: cheetah Nov 30 06:23:53 user nova-compute[75021]: virt-2.6 Nov 30 06:23:53 user nova-compute[75021]: ast2500-evb Nov 30 06:23:53 user nova-compute[75021]: highbank Nov 30 06:23:53 user nova-compute[75021]: akita Nov 30 06:23:53 user nova-compute[75021]: connex Nov 30 06:23:53 user nova-compute[75021]: netduinoplus2 Nov 30 06:23:53 user nova-compute[75021]: collie Nov 30 06:23:53 user nova-compute[75021]: raspi0 Nov 30 06:23:53 user nova-compute[75021]: fp5280g2-bmc Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-cris Nov 30 06:23:53 user nova-compute[75021]: axis-dev88 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-i386 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy Nov 30 06:23:53 user nova-compute[75021]: ubuntu Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-impish-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.12 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-xenial Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.2 Nov 30 06:23:53 user nova-compute[75021]: pc Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.5 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-focal Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-hirsute Nov 30 06:23:53 user nova-compute[75021]: pc-q35-xenial Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.5 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-eoan-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-zesty Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-disco-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-groovy Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-groovy Nov 30 06:23:53 user nova-compute[75021]: pc-q35-artful Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-trusty Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-eoan-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-focal-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-bionic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-artful Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-yakkety Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.4 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-cosmic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.10 Nov 30 06:23:53 user nova-compute[75021]: x-remote Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.9 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.11 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-3.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy Nov 30 06:23:53 user nova-compute[75021]: ubuntu-q35 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.4 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-eoan Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.9 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-bionic-hpb Nov 30 06:23:53 user nova-compute[75021]: isapc Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.4 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-cosmic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.6 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-3.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-bionic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-disco-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-cosmic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.12 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-bionic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-groovy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-disco Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-cosmic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-wily Nov 30 06:23:53 user nova-compute[75021]: pc-q35-impish Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-impish Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.6 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-impish-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-hirsute Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.0.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-hirsute-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.6 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.8 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.10 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-3.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-zesty Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-focal Nov 30 06:23:53 user nova-compute[75021]: microvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.3 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-focal-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-disco Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-groovy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-hirsute-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.2 Nov 30 06:23:53 user nova-compute[75021]: q35 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.8 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-eoan Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.5 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-3.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-yakkety Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.11 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-m68k Nov 30 06:23:53 user nova-compute[75021]: mcf5208evb Nov 30 06:23:53 user nova-compute[75021]: an5206 Nov 30 06:23:53 user nova-compute[75021]: virt-6.0 Nov 30 06:23:53 user nova-compute[75021]: q800 Nov 30 06:23:53 user nova-compute[75021]: virt-6.2 Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: next-cube Nov 30 06:23:53 user nova-compute[75021]: virt-6.1 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-microblaze Nov 30 06:23:53 user nova-compute[75021]: petalogix-s3adsp1800 Nov 30 06:23:53 user nova-compute[75021]: petalogix-ml605 Nov 30 06:23:53 user nova-compute[75021]: xlnx-zynqmp-pmu Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-microblazeel Nov 30 06:23:53 user nova-compute[75021]: petalogix-s3adsp1800 Nov 30 06:23:53 user nova-compute[75021]: petalogix-ml605 Nov 30 06:23:53 user nova-compute[75021]: xlnx-zynqmp-pmu Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-mips Nov 30 06:23:53 user nova-compute[75021]: malta Nov 30 06:23:53 user nova-compute[75021]: mipssim Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-mipsel Nov 30 06:23:53 user nova-compute[75021]: malta Nov 30 06:23:53 user nova-compute[75021]: mipssim Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-mips64 Nov 30 06:23:53 user nova-compute[75021]: malta Nov 30 06:23:53 user nova-compute[75021]: mipssim Nov 30 06:23:53 user nova-compute[75021]: pica61 Nov 30 06:23:53 user nova-compute[75021]: magnum Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-mips64el Nov 30 06:23:53 user nova-compute[75021]: malta Nov 30 06:23:53 user nova-compute[75021]: loongson3-virt Nov 30 06:23:53 user nova-compute[75021]: mipssim Nov 30 06:23:53 user nova-compute[75021]: pica61 Nov 30 06:23:53 user nova-compute[75021]: magnum Nov 30 06:23:53 user nova-compute[75021]: boston Nov 30 06:23:53 user nova-compute[75021]: fuloong2e Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-ppc Nov 30 06:23:53 user nova-compute[75021]: g3beige Nov 30 06:23:53 user nova-compute[75021]: virtex-ml507 Nov 30 06:23:53 user nova-compute[75021]: mac99 Nov 30 06:23:53 user nova-compute[75021]: ppce500 Nov 30 06:23:53 user nova-compute[75021]: pegasos2 Nov 30 06:23:53 user nova-compute[75021]: sam460ex Nov 30 06:23:53 user nova-compute[75021]: bamboo Nov 30 06:23:53 user nova-compute[75021]: 40p Nov 30 06:23:53 user nova-compute[75021]: ref405ep Nov 30 06:23:53 user nova-compute[75021]: mpc8544ds Nov 30 06:23:53 user nova-compute[75021]: taihu Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-ppc64 Nov 30 06:23:53 user nova-compute[75021]: pseries-jammy Nov 30 06:23:53 user nova-compute[75021]: pseries Nov 30 06:23:53 user nova-compute[75021]: powernv9 Nov 30 06:23:53 user nova-compute[75021]: powernv Nov 30 06:23:53 user nova-compute[75021]: taihu Nov 30 06:23:53 user nova-compute[75021]: pseries-4.1 Nov 30 06:23:53 user nova-compute[75021]: mpc8544ds Nov 30 06:23:53 user nova-compute[75021]: pseries-6.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.5 Nov 30 06:23:53 user nova-compute[75021]: powernv10 Nov 30 06:23:53 user nova-compute[75021]: pseries-xenial Nov 30 06:23:53 user nova-compute[75021]: pseries-4.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-6.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-yakkety Nov 30 06:23:53 user nova-compute[75021]: pseries-2.6 Nov 30 06:23:53 user nova-compute[75021]: ppce500 Nov 30 06:23:53 user nova-compute[75021]: pseries-bionic-sxxm Nov 30 06:23:53 user nova-compute[75021]: pseries-2.7 Nov 30 06:23:53 user nova-compute[75021]: pseries-3.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-5.0 Nov 30 06:23:53 user nova-compute[75021]: 40p Nov 30 06:23:53 user nova-compute[75021]: pseries-2.8 Nov 30 06:23:53 user nova-compute[75021]: pegasos2 Nov 30 06:23:53 user nova-compute[75021]: pseries-hirsute Nov 30 06:23:53 user nova-compute[75021]: pseries-3.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-5.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-eoan Nov 30 06:23:53 user nova-compute[75021]: pseries-2.9 Nov 30 06:23:53 user nova-compute[75021]: pseries-zesty Nov 30 06:23:53 user nova-compute[75021]: bamboo Nov 30 06:23:53 user nova-compute[75021]: pseries-groovy Nov 30 06:23:53 user nova-compute[75021]: pseries-focal Nov 30 06:23:53 user nova-compute[75021]: g3beige Nov 30 06:23:53 user nova-compute[75021]: pseries-5.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-disco Nov 30 06:23:53 user nova-compute[75021]: pseries-2.12-sxxm Nov 30 06:23:53 user nova-compute[75021]: pseries-2.10 Nov 30 06:23:53 user nova-compute[75021]: virtex-ml507 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.11 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-cosmic Nov 30 06:23:53 user nova-compute[75021]: pseries-bionic Nov 30 06:23:53 user nova-compute[75021]: pseries-2.12 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.2 Nov 30 06:23:53 user nova-compute[75021]: mac99 Nov 30 06:23:53 user nova-compute[75021]: pseries-impish Nov 30 06:23:53 user nova-compute[75021]: pseries-artful Nov 30 06:23:53 user nova-compute[75021]: sam460ex Nov 30 06:23:53 user nova-compute[75021]: ref405ep Nov 30 06:23:53 user nova-compute[75021]: pseries-2.3 Nov 30 06:23:53 user nova-compute[75021]: powernv8 Nov 30 06:23:53 user nova-compute[75021]: pseries-4.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-6.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.4 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-ppc64le Nov 30 06:23:53 user nova-compute[75021]: pseries-jammy Nov 30 06:23:53 user nova-compute[75021]: pseries Nov 30 06:23:53 user nova-compute[75021]: powernv9 Nov 30 06:23:53 user nova-compute[75021]: powernv Nov 30 06:23:53 user nova-compute[75021]: taihu Nov 30 06:23:53 user nova-compute[75021]: pseries-4.1 Nov 30 06:23:53 user nova-compute[75021]: mpc8544ds Nov 30 06:23:53 user nova-compute[75021]: pseries-6.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.5 Nov 30 06:23:53 user nova-compute[75021]: powernv10 Nov 30 06:23:53 user nova-compute[75021]: pseries-xenial Nov 30 06:23:53 user nova-compute[75021]: pseries-4.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-6.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-yakkety Nov 30 06:23:53 user nova-compute[75021]: pseries-2.6 Nov 30 06:23:53 user nova-compute[75021]: ppce500 Nov 30 06:23:53 user nova-compute[75021]: pseries-bionic-sxxm Nov 30 06:23:53 user nova-compute[75021]: pseries-2.7 Nov 30 06:23:53 user nova-compute[75021]: pseries-3.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-5.0 Nov 30 06:23:53 user nova-compute[75021]: 40p Nov 30 06:23:53 user nova-compute[75021]: pseries-2.8 Nov 30 06:23:53 user nova-compute[75021]: pegasos2 Nov 30 06:23:53 user nova-compute[75021]: pseries-hirsute Nov 30 06:23:53 user nova-compute[75021]: pseries-3.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-5.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-eoan Nov 30 06:23:53 user nova-compute[75021]: pseries-2.9 Nov 30 06:23:53 user nova-compute[75021]: pseries-zesty Nov 30 06:23:53 user nova-compute[75021]: bamboo Nov 30 06:23:53 user nova-compute[75021]: pseries-groovy Nov 30 06:23:53 user nova-compute[75021]: pseries-focal Nov 30 06:23:53 user nova-compute[75021]: g3beige Nov 30 06:23:53 user nova-compute[75021]: pseries-5.2 Nov 30 06:23:53 user nova-compute[75021]: pseries-disco Nov 30 06:23:53 user nova-compute[75021]: pseries-2.12-sxxm Nov 30 06:23:53 user nova-compute[75021]: pseries-2.10 Nov 30 06:23:53 user nova-compute[75021]: virtex-ml507 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.11 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.1 Nov 30 06:23:53 user nova-compute[75021]: pseries-cosmic Nov 30 06:23:53 user nova-compute[75021]: pseries-bionic Nov 30 06:23:53 user nova-compute[75021]: pseries-2.12 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.2 Nov 30 06:23:53 user nova-compute[75021]: mac99 Nov 30 06:23:53 user nova-compute[75021]: pseries-impish Nov 30 06:23:53 user nova-compute[75021]: pseries-artful Nov 30 06:23:53 user nova-compute[75021]: sam460ex Nov 30 06:23:53 user nova-compute[75021]: ref405ep Nov 30 06:23:53 user nova-compute[75021]: pseries-2.3 Nov 30 06:23:53 user nova-compute[75021]: powernv8 Nov 30 06:23:53 user nova-compute[75021]: pseries-4.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-6.0 Nov 30 06:23:53 user nova-compute[75021]: pseries-2.4 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-riscv32 Nov 30 06:23:53 user nova-compute[75021]: spike Nov 30 06:23:53 user nova-compute[75021]: opentitan Nov 30 06:23:53 user nova-compute[75021]: sifive_u Nov 30 06:23:53 user nova-compute[75021]: sifive_e Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-riscv64 Nov 30 06:23:53 user nova-compute[75021]: spike Nov 30 06:23:53 user nova-compute[75021]: microchip-icicle-kit Nov 30 06:23:53 user nova-compute[75021]: sifive_u Nov 30 06:23:53 user nova-compute[75021]: shakti_c Nov 30 06:23:53 user nova-compute[75021]: sifive_e Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-s390x Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-jammy Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-4.0 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-5.2 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-artful Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-3.1 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-groovy Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-hirsute Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-disco Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.12 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.6 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-yakkety Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-eoan Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.9 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-6.0 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-5.1 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-3.0 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-4.2 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.5 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.11 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-xenial Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-focal Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.8 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-impish Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-bionic Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-5.0 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-6.2 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-zesty Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-4.1 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-cosmic Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.4 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.10 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-2.7 Nov 30 06:23:53 user nova-compute[75021]: s390-ccw-virtio-6.1 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-sh4 Nov 30 06:23:53 user nova-compute[75021]: shix Nov 30 06:23:53 user nova-compute[75021]: r2d Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-sh4eb Nov 30 06:23:53 user nova-compute[75021]: shix Nov 30 06:23:53 user nova-compute[75021]: r2d Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-sparc Nov 30 06:23:53 user nova-compute[75021]: SS-5 Nov 30 06:23:53 user nova-compute[75021]: SS-20 Nov 30 06:23:53 user nova-compute[75021]: LX Nov 30 06:23:53 user nova-compute[75021]: SPARCClassic Nov 30 06:23:53 user nova-compute[75021]: leon3_generic Nov 30 06:23:53 user nova-compute[75021]: SPARCbook Nov 30 06:23:53 user nova-compute[75021]: SS-4 Nov 30 06:23:53 user nova-compute[75021]: SS-600MP Nov 30 06:23:53 user nova-compute[75021]: SS-10 Nov 30 06:23:53 user nova-compute[75021]: Voyager Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-sparc64 Nov 30 06:23:53 user nova-compute[75021]: sun4u Nov 30 06:23:53 user nova-compute[75021]: niagara Nov 30 06:23:53 user nova-compute[75021]: sun4v Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 64 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-x86_64 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy Nov 30 06:23:53 user nova-compute[75021]: ubuntu Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-impish-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.12 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-xenial Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.2 Nov 30 06:23:53 user nova-compute[75021]: pc Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.5 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-hirsute Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-focal Nov 30 06:23:53 user nova-compute[75021]: pc-q35-xenial Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.2 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.5 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-eoan-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-zesty Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-disco-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-groovy Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-groovy Nov 30 06:23:53 user nova-compute[75021]: pc-q35-artful Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-trusty Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.2 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-focal-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-eoan-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-bionic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-artful Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-yakkety Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.4 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-cosmic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.10 Nov 30 06:23:53 user nova-compute[75021]: x-remote Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.7 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.9 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.11 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-3.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy Nov 30 06:23:53 user nova-compute[75021]: ubuntu-q35 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.4 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-eoan Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.9 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-bionic-hpb Nov 30 06:23:53 user nova-compute[75021]: isapc Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.4 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-cosmic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.6 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-3.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-bionic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-disco-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-cosmic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.12 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-bionic Nov 30 06:23:53 user nova-compute[75021]: pc-q35-groovy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-disco Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-cosmic-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.1 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-wily Nov 30 06:23:53 user nova-compute[75021]: pc-q35-impish Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.6 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-impish Nov 30 06:23:53 user nova-compute[75021]: pc-q35-impish-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-q35-hirsute Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.0.1 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-hirsute-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-1.6 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-5.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.8 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.10 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-3.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-zesty Nov 30 06:23:53 user nova-compute[75021]: pc-q35-4.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-focal Nov 30 06:23:53 user nova-compute[75021]: microvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.3 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-disco Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-focal-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-4.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-groovy-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-hirsute-hpb Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-5.0 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-2.8 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.2 Nov 30 06:23:53 user nova-compute[75021]: q35 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-eoan Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.5 Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-3.0 Nov 30 06:23:53 user nova-compute[75021]: pc-q35-yakkety Nov 30 06:23:53 user nova-compute[75021]: pc-q35-2.11 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-xtensa Nov 30 06:23:53 user nova-compute[75021]: sim Nov 30 06:23:53 user nova-compute[75021]: kc705 Nov 30 06:23:53 user nova-compute[75021]: ml605 Nov 30 06:23:53 user nova-compute[75021]: ml605-nommu Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: lx60-nommu Nov 30 06:23:53 user nova-compute[75021]: lx200 Nov 30 06:23:53 user nova-compute[75021]: lx200-nommu Nov 30 06:23:53 user nova-compute[75021]: lx60 Nov 30 06:23:53 user nova-compute[75021]: kc705-nommu Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: hvm Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: 32 Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-xtensaeb Nov 30 06:23:53 user nova-compute[75021]: sim Nov 30 06:23:53 user nova-compute[75021]: kc705 Nov 30 06:23:53 user nova-compute[75021]: ml605 Nov 30 06:23:53 user nova-compute[75021]: ml605-nommu Nov 30 06:23:53 user nova-compute[75021]: virt Nov 30 06:23:53 user nova-compute[75021]: lx60-nommu Nov 30 06:23:53 user nova-compute[75021]: lx200 Nov 30 06:23:53 user nova-compute[75021]: lx200-nommu Nov 30 06:23:53 user nova-compute[75021]: lx60 Nov 30 06:23:53 user nova-compute[75021]: kc705-nommu Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-i386 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy Nov 30 06:23:53 user nova-compute[75021]: i686 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF32_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.ms.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-i386 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy Nov 30 06:23:53 user nova-compute[75021]: i686 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF32_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.ms.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: ide Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-i386 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.2 Nov 30 06:23:53 user nova-compute[75021]: i686 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF32_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.ms.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-i386 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.2 Nov 30 06:23:53 user nova-compute[75021]: i686 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/AAVMF/AAVMF32_CODE.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE.ms.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: ide Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-x86_64 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-q35-jammy Nov 30 06:23:53 user nova-compute[75021]: x86_64 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: efi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-x86_64 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-jammy Nov 30 06:23:53 user nova-compute[75021]: x86_64 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: efi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: ide Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-x86_64 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-q35-6.2 Nov 30 06:23:53 user nova-compute[75021]: x86_64 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: efi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/bin/qemu-system-x86_64 Nov 30 06:23:53 user nova-compute[75021]: kvm Nov 30 06:23:53 user nova-compute[75021]: pc-i440fx-6.2 Nov 30 06:23:53 user nova-compute[75021]: x86_64 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: efi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: /usr/share/OVMF/OVMF_CODE_4M.fd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: rom Nov 30 06:23:53 user nova-compute[75021]: pflash Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: yes Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: no Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: on Nov 30 06:23:53 user nova-compute[75021]: off Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: Intel Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: qemu64 Nov 30 06:23:53 user nova-compute[75021]: qemu32 Nov 30 06:23:53 user nova-compute[75021]: phenom Nov 30 06:23:53 user nova-compute[75021]: pentium3 Nov 30 06:23:53 user nova-compute[75021]: pentium2 Nov 30 06:23:53 user nova-compute[75021]: pentium Nov 30 06:23:53 user nova-compute[75021]: n270 Nov 30 06:23:53 user nova-compute[75021]: kvm64 Nov 30 06:23:53 user nova-compute[75021]: kvm32 Nov 30 06:23:53 user nova-compute[75021]: coreduo Nov 30 06:23:53 user nova-compute[75021]: core2duo Nov 30 06:23:53 user nova-compute[75021]: athlon Nov 30 06:23:53 user nova-compute[75021]: Westmere-IBRS Nov 30 06:23:53 user nova-compute[75021]: Westmere Nov 30 06:23:53 user nova-compute[75021]: Snowridge Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Server Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client-IBRS Nov 30 06:23:53 user nova-compute[75021]: Skylake-Client Nov 30 06:23:53 user nova-compute[75021]: SandyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: SandyBridge Nov 30 06:23:53 user nova-compute[75021]: Penryn Nov 30 06:23:53 user nova-compute[75021]: Opteron_G5 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G4 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G3 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G2 Nov 30 06:23:53 user nova-compute[75021]: Opteron_G1 Nov 30 06:23:53 user nova-compute[75021]: Nehalem-IBRS Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: IvyBridge-IBRS Nov 30 06:23:53 user nova-compute[75021]: IvyBridge Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Server Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client-noTSX Nov 30 06:23:53 user nova-compute[75021]: Icelake-Client Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Haswell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Haswell Nov 30 06:23:53 user nova-compute[75021]: EPYC-Rome Nov 30 06:23:53 user nova-compute[75021]: EPYC-Milan Nov 30 06:23:53 user nova-compute[75021]: EPYC-IBPB Nov 30 06:23:53 user nova-compute[75021]: EPYC Nov 30 06:23:53 user nova-compute[75021]: Dhyana Nov 30 06:23:53 user nova-compute[75021]: Cooperlake Nov 30 06:23:53 user nova-compute[75021]: Conroe Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server-noTSX Nov 30 06:23:53 user nova-compute[75021]: Cascadelake-Server Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell-noTSX Nov 30 06:23:53 user nova-compute[75021]: Broadwell-IBRS Nov 30 06:23:53 user nova-compute[75021]: Broadwell Nov 30 06:23:53 user nova-compute[75021]: 486 Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: file Nov 30 06:23:53 user nova-compute[75021]: anonymous Nov 30 06:23:53 user nova-compute[75021]: memfd Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: disk Nov 30 06:23:53 user nova-compute[75021]: cdrom Nov 30 06:23:53 user nova-compute[75021]: floppy Nov 30 06:23:53 user nova-compute[75021]: lun Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: ide Nov 30 06:23:53 user nova-compute[75021]: fdc Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: sata Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: sdl Nov 30 06:23:53 user nova-compute[75021]: vnc Nov 30 06:23:53 user nova-compute[75021]: spice Nov 30 06:23:53 user nova-compute[75021]: egl-headless Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: subsystem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: default Nov 30 06:23:53 user nova-compute[75021]: mandatory Nov 30 06:23:53 user nova-compute[75021]: requisite Nov 30 06:23:53 user nova-compute[75021]: optional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: usb Nov 30 06:23:53 user nova-compute[75021]: pci Nov 30 06:23:53 user nova-compute[75021]: scsi Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: virtio Nov 30 06:23:53 user nova-compute[75021]: virtio-transitional Nov 30 06:23:53 user nova-compute[75021]: virtio-non-transitional Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: random Nov 30 06:23:53 user nova-compute[75021]: egd Nov 30 06:23:53 user nova-compute[75021]: builtin Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: path Nov 30 06:23:53 user nova-compute[75021]: handle Nov 30 06:23:53 user nova-compute[75021]: virtiofs Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: tpm-tis Nov 30 06:23:53 user nova-compute[75021]: tpm-crb Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: passthrough Nov 30 06:23:53 user nova-compute[75021]: emulator Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}} Nov 30 06:23:53 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Secure Boot support detected Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] cpu compare xml: Nov 30 06:23:53 user nova-compute[75021]: Nehalem Nov 30 06:23:53 user nova-compute[75021]: Nov 30 06:23:53 user nova-compute[75021]: {{(pid=75021) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}} Nov 30 06:23:53 user nova-compute[75021]: INFO nova.virt.node [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Generated node identity c24a175c-4584-420f-87fd-9adb114da12c Nov 30 06:23:53 user nova-compute[75021]: INFO nova.virt.node [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Wrote node identity c24a175c-4584-420f-87fd-9adb114da12c to /opt/stack/data/nova/compute_id Nov 30 06:23:53 user nova-compute[75021]: WARNING nova.compute.manager [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Compute nodes ['c24a175c-4584-420f-87fd-9adb114da12c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Nov 30 06:23:53 user nova-compute[75021]: INFO nova.compute.manager [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Nov 30 06:23:53 user nova-compute[75021]: WARNING nova.compute.manager [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found. Nov 30 06:23:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:23:53 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:23:53 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Hypervisor/Node resource view: name=user free_ram=10979MB free_disk=26.154842376708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:23:53 user nova-compute[75021]: WARNING nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] No compute node record for user:c24a175c-4584-420f-87fd-9adb114da12c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c24a175c-4584-420f-87fd-9adb114da12c could not be found. Nov 30 06:23:53 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Compute node record created for user:user with uuid: c24a175c-4584-420f-87fd-9adb114da12c Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:23:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:23:53 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] [req-2eb7c349-2de6-44ed-82b9-7eba78a8c5ca] Created resource provider record via placement API for resource provider with UUID c24a175c-4584-420f-87fd-9adb114da12c and name user. Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75021) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}} Nov 30 06:23:54 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] kernel doesn't support AMD SEV Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Updating inventory in ProviderTree for provider c24a175c-4584-420f-87fd-9adb114da12c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Libvirt baseline CPU Nov 30 06:23:54 user nova-compute[75021]: x86_64 Nov 30 06:23:54 user nova-compute[75021]: Nehalem Nov 30 06:23:54 user nova-compute[75021]: Intel Nov 30 06:23:54 user nova-compute[75021]: Nov 30 06:23:54 user nova-compute[75021]: Nov 30 06:23:54 user nova-compute[75021]: {{(pid=75021) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Updated inventory for provider c24a175c-4584-420f-87fd-9adb114da12c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Updating resource provider c24a175c-4584-420f-87fd-9adb114da12c generation from 0 to 1 during operation: update_inventory {{(pid=75021) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Updating inventory in ProviderTree for provider c24a175c-4584-420f-87fd-9adb114da12c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Updating resource provider c24a175c-4584-420f-87fd-9adb114da12c generation from 1 to 2 during operation: update_traits {{(pid=75021) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.service [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Creating RPC server for service compute {{(pid=75021) start /opt/stack/nova/nova/service.py:182}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.service [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] Join ServiceGroup membership for this service compute {{(pid=75021) start /opt/stack/nova/nova/service.py:199}} Nov 30 06:23:54 user nova-compute[75021]: DEBUG nova.servicegroup.drivers.db [None req-71ed7765-00b2-4979-9036-20c30137a31d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = {{(pid=75021) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Nov 30 06:24:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:24:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:24:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=10399MB free_disk=26.05858612060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:24:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:25:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:25:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:25:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=10329MB free_disk=26.123619079589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:25:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}} Nov 30 06:25:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:26:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:26:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=10306MB free_disk=25.875404357910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:26:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} Nov 30 06:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}} Nov 30 06:26:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:27:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:27:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=9617MB free_disk=25.896183013916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:27:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:27:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:27:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:27:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} Nov 30 06:27:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}} Nov 30 06:27:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:27:59 user nova-compute[75021]: INFO nova.compute.claims [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Claim successful on node user Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:27:59 user nova-compute[75021]: INFO nova.compute.claims [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Claim successful on node user Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:27:59 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:27:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.360s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:00 user nova-compute[75021]: INFO nova.compute.claims [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Claim successful on node user Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Creating image(s) Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "/opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "/opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.policy [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3b685eaadbd4993b544980bfdea9235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98342e6fa562410cb1746992525f2fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.policy [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '728a965ff86d42a0b37efb0b6e39bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91080509e144b6ca051cdde9dffdffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.virt.images [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] 810aca46-134d-4ee2-b71a-3a2467a4bcb8 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.part /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Creating image(s) Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "/opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "/opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.980s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.part /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.converted" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.161s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:01 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprkscferv/privsep.sock'] Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.387s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:01 user sudo[84539]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprkscferv/privsep.sock Nov 30 06:28:01 user sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Creating image(s) Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "/opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "/opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:01 user nova-compute[75021]: DEBUG nova.policy [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbc2e83db92a4551a7aabdf1111ecdc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3936fa50a9544fcb9aaf6f46d45eda7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Successfully created port: 1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:03 user sudo[84539]: pam_unix(sudo:session): session closed for user root Nov 30 06:28:03 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Spawned new privsep daemon via rootwrap Nov 30 06:28:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 30 06:28:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 30 06:28:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 30 06:28:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84550 Nov 30 06:28:03 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] privsep daemon already running Nov 30 06:28:03 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] privsep daemon already running Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:03 user nova-compute[75021]: INFO nova.compute.claims [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Claim successful on node user Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Successfully created port: 3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk 1073741824" returned: 0 in 0.074s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.264s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.258s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.204s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.policy [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0200b58bd1534bc28872adc5cf426ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de15912e470d4bc0b9ab9f3fb6142c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Cannot resize image /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Ensure instance console log exists: /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk 1073741824" returned: 0 in 0.125s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.334s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.591s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Creating image(s) Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "/opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.142s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.224s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Successfully created port: 6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.324s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk 1073741824" returned: 0 in 0.082s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.323s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Cannot resize image /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Ensure instance console log exists: /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.219s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk 1073741824" returned: 0 in 0.054s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.278s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Cannot resize image /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Ensure instance console log exists: /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Cannot resize image /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Ensure instance console log exists: /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Successfully updated port: 1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquired lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Successfully created port: 41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Successfully updated port: 3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquired lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-changed-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Refreshing instance network info cache due to event network-changed-1bb1058b-c894-4e0a-90f0-e55b835b8679. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] Acquiring lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-changed-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Refreshing instance network info cache due to event network-changed-3a8ed156-52bd-44e0-b5c3-e149acfab6c9. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] Acquiring lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating instance_info_cache with network_info: [{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Releasing lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance network_info: |[{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] Acquired lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Refreshing network info cache for port 1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Start _get_guest_xml network_info=[{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1357487691',display_name='tempest-AttachVolumeTestJSON-server-1357487691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1357487691',id=1,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMznkj7B92rG9oZ1PxSeZBMOvqjGEzLI1aFFJ1QuTq1ou2nXdQqcjWpOGFxFpRoOM7A4awCh8x5z3xerOZ6um74arCyWudJs21u/uURimEpv500BhrT+nmuXGmWzRny35Q==',key_name='tempest-keypair-1401620803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91080509e144b6ca051cdde9dffdffc',ramdisk_id='',reservation_id='r-8k2g0ev2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1859687396',owner_user_name='tempest-AttachVolumeTestJSON-1859687396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='728a965ff86d42a0b37efb0b6e39bded',uuid=9f0fa9f8-75a4-48ba-8096-49e7665a0511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converting VIF {"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] End _get_guest_xml xml= Nov 30 06:28:07 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:28:07 user nova-compute[75021]: instance-00000001 Nov 30 06:28:07 user nova-compute[75021]: 524288 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: tempest-AttachVolumeTestJSON-server-1357487691 Nov 30 06:28:07 user nova-compute[75021]: 2023-11-30 06:28:07 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: 512 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: 0 Nov 30 06:28:07 user nova-compute[75021]: 0 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: tempest-AttachVolumeTestJSON-1859687396-project-member Nov 30 06:28:07 user nova-compute[75021]: tempest-AttachVolumeTestJSON-1859687396 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:07 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:07 user nova-compute[75021]: 0.0.0 Nov 30 06:28:07 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:28:07 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:28:07 user nova-compute[75021]: Virtual Machine Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: hvm Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nehalem Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: /dev/urandom Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1357487691',display_name='tempest-AttachVolumeTestJSON-server-1357487691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1357487691',id=1,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMznkj7B92rG9oZ1PxSeZBMOvqjGEzLI1aFFJ1QuTq1ou2nXdQqcjWpOGFxFpRoOM7A4awCh8x5z3xerOZ6um74arCyWudJs21u/uURimEpv500BhrT+nmuXGmWzRny35Q==',key_name='tempest-keypair-1401620803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91080509e144b6ca051cdde9dffdffc',ramdisk_id='',reservation_id='r-8k2g0ev2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1859687396',owner_user_name='tempest-AttachVolumeTestJSON-1859687396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='728a965ff86d42a0b37efb0b6e39bded',uuid=9f0fa9f8-75a4-48ba-8096-49e7665a0511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converting VIF {"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG os_vif [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Created schema index Interface.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Created schema index Port.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Created schema index Bridge.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [POLLOUT] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Successfully updated port: 6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59733c3d-6bd3-59a1-ac76-5713c25b9fce', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:07 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8oqyfw46/privsep.sock'] Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:07 user sudo[84637]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8oqyfw46/privsep.sock Nov 30 06:28:07 user sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updating instance_info_cache with network_info: [{"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Releasing lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Instance network_info: |[{"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] Acquired lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Refreshing network info cache for port 3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Start _get_guest_xml network_info=[{"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1707127936',display_name='tempest-DeleteServersTestJSON-server-1707127936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1707127936',id=2,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98342e6fa562410cb1746992525f2fda',ramdisk_id='',reservation_id='r-6p19rda6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1072197748',owner_user_name='tempest-DeleteServersTestJSON-1072197748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:01Z,user_data=None,user_id='f3b685eaadbd4993b544980bfdea9235',uuid=7ba0b8d8-e743-40ec-9c7d-5656055b0b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converting VIF {"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] End _get_guest_xml xml= Nov 30 06:28:07 user nova-compute[75021]: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 Nov 30 06:28:07 user nova-compute[75021]: instance-00000002 Nov 30 06:28:07 user nova-compute[75021]: 524288 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: tempest-DeleteServersTestJSON-server-1707127936 Nov 30 06:28:07 user nova-compute[75021]: 2023-11-30 06:28:07 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: 512 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: 0 Nov 30 06:28:07 user nova-compute[75021]: 0 Nov 30 06:28:07 user nova-compute[75021]: 1 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: tempest-DeleteServersTestJSON-1072197748-project-member Nov 30 06:28:07 user nova-compute[75021]: tempest-DeleteServersTestJSON-1072197748 Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:07 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:07 user nova-compute[75021]: 0.0.0 Nov 30 06:28:07 user nova-compute[75021]: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 Nov 30 06:28:07 user nova-compute[75021]: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 Nov 30 06:28:07 user nova-compute[75021]: Virtual Machine Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: hvm Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nehalem Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: /dev/urandom Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: Nov 30 06:28:07 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1707127936',display_name='tempest-DeleteServersTestJSON-server-1707127936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1707127936',id=2,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98342e6fa562410cb1746992525f2fda',ramdisk_id='',reservation_id='r-6p19rda6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1072197748',owner_user_name='tempest-DeleteServersTestJSON-1072197748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:01Z,user_data=None,user_id='f3b685eaadbd4993b544980bfdea9235',uuid=7ba0b8d8-e743-40ec-9c7d-5656055b0b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converting VIF {"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG os_vif [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72d65ed9-cde0-5a35-8509-6d7469ccd053', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance network_info: |[{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start _get_guest_xml network_info=[{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] End _get_guest_xml xml= Nov 30 06:28:08 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:28:08 user nova-compute[75021]: instance-00000003 Nov 30 06:28:08 user nova-compute[75021]: 524288 Nov 30 06:28:08 user nova-compute[75021]: 1 Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: tempest-ServerActionsTestOtherB-server-814384843 Nov 30 06:28:08 user nova-compute[75021]: 2023-11-30 06:28:08 Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: 512 Nov 30 06:28:08 user nova-compute[75021]: 1 Nov 30 06:28:08 user nova-compute[75021]: 0 Nov 30 06:28:08 user nova-compute[75021]: 0 Nov 30 06:28:08 user nova-compute[75021]: 1 Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113-project-member Nov 30 06:28:08 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113 Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:08 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:08 user nova-compute[75021]: 0.0.0 Nov 30 06:28:08 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:28:08 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:28:08 user nova-compute[75021]: Virtual Machine Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: hvm Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nehalem Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: /dev/urandom Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: Nov 30 06:28:08 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG os_vif [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3cf38a-7f55-5208-ac42-9fc77b9d2c74', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Successfully updated port: 41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updated VIF entry in instance network info cache for port 3a8ed156-52bd-44e0-b5c3-e149acfab6c9. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updating instance_info_cache with network_info: [{"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquired lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e391ff-0809-4f7f-bfc5-594fbe963c60 req-1c5ff118-7db3-4bf0-bba8-f922dc4533e1 service nova] Releasing lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-changed-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Refreshing instance network info cache due to event network-changed-6588b659-358d-40ed-9176-a98946d4cc7c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:08 user nova-compute[75021]: DEBUG nova.network.neutron [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Refreshing network info cache for port 6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updated VIF entry in instance network info cache for port 1bb1058b-c894-4e0a-90f0-e55b835b8679. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating instance_info_cache with network_info: [{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c647e1a-335b-4c75-b61e-91dc20271eb1 req-dc62053e-38e7-4c38-bf4c-1697f9fd44de service nova] Releasing lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received event network-changed-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Refreshing instance network info cache due to event network-changed-41865556-22cf-4324-9f33-7fe485aefed0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] Acquiring lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user sudo[84637]: pam_unix(sudo:session): session closed for user root Nov 30 06:28:09 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Spawned new privsep daemon via rootwrap Nov 30 06:28:09 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 30 06:28:09 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 30 06:28:09 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Nov 30 06:28:09 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84640 Nov 30 06:28:09 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] privsep daemon already running Nov 30 06:28:09 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] privsep daemon already running Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updating instance_info_cache with network_info: [{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Releasing lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Instance network_info: |[{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] Acquired lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Refreshing network info cache for port 41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Start _get_guest_xml network_info=[{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-517710799',display_name='tempest-ServerActionsTestOtherA-server-517710799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-517710799',id=4,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJIlY0lnzZZZ/EbmmBuXuKtBJJpEFzJQCyOqxMdGioPZbOASXOp7jCufATIBpZKRfn6CWlXcBqKpYfkynDy3pjqc+xrdy4ydiUrPmNqrkNVuGXcukhKmO/5gAq1MeIFeA==',key_name='tempest-keypair-458421576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-a4mcpf20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=63ed94e2-f3c4-48ca-8c90-29ddf619e309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=41865556-22cf-4324-9f33-7fe485aefed0,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41865556-22') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lazy-loading 'pci_devices' on Instance uuid 63ed94e2-f3c4-48ca-8c90-29ddf619e309 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] End _get_guest_xml xml= Nov 30 06:28:09 user nova-compute[75021]: 63ed94e2-f3c4-48ca-8c90-29ddf619e309 Nov 30 06:28:09 user nova-compute[75021]: instance-00000004 Nov 30 06:28:09 user nova-compute[75021]: 524288 Nov 30 06:28:09 user nova-compute[75021]: 1 Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: tempest-ServerActionsTestOtherA-server-517710799 Nov 30 06:28:09 user nova-compute[75021]: 2023-11-30 06:28:09 Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: 512 Nov 30 06:28:09 user nova-compute[75021]: 1 Nov 30 06:28:09 user nova-compute[75021]: 0 Nov 30 06:28:09 user nova-compute[75021]: 0 Nov 30 06:28:09 user nova-compute[75021]: 1 Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321-project-member Nov 30 06:28:09 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321 Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:09 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:09 user nova-compute[75021]: 0.0.0 Nov 30 06:28:09 user nova-compute[75021]: 63ed94e2-f3c4-48ca-8c90-29ddf619e309 Nov 30 06:28:09 user nova-compute[75021]: 63ed94e2-f3c4-48ca-8c90-29ddf619e309 Nov 30 06:28:09 user nova-compute[75021]: Virtual Machine Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: hvm Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nehalem Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: /dev/urandom Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: Nov 30 06:28:09 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-517710799',display_name='tempest-ServerActionsTestOtherA-server-517710799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-517710799',id=4,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJIlY0lnzZZZ/EbmmBuXuKtBJJpEFzJQCyOqxMdGioPZbOASXOp7jCufATIBpZKRfn6CWlXcBqKpYfkynDy3pjqc+xrdy4ydiUrPmNqrkNVuGXcukhKmO/5gAq1MeIFeA==',key_name='tempest-keypair-458421576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-a4mcpf20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=63ed94e2-f3c4-48ca-8c90-29ddf619e309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=41865556-22cf-4324-9f33-7fe485aefed0,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41865556-22') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG os_vif [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=41865556-22cf-4324-9f33-7fe485aefed0,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41865556-22') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da5639cd-b0b6-5278-82a2-930dba3007a6', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb1058b-c8, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb1058b-c8, col_values=(('qos', UUID('363940cf-ff78-4158-8864-acf65d9edf7f')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb1058b-c8, col_values=(('external_ids', {'iface-id': '1bb1058b-c894-4e0a-90f0-e55b835b8679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:fb:b2', 'vm-uuid': '9f0fa9f8-75a4-48ba-8096-49e7665a0511'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: INFO os_vif [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41865556-22, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41865556-22, col_values=(('qos', UUID('56eb0ca3-8632-42ff-afe0-4ce5361afb57')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41865556-22, col_values=(('external_ids', {'iface-id': '41865556-22cf-4324-9f33-7fe485aefed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5c:37', 'vm-uuid': '63ed94e2-f3c4-48ca-8c90-29ddf619e309'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: INFO os_vif [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=41865556-22cf-4324-9f33-7fe485aefed0,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41865556-22') Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a8ed156-52, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a8ed156-52, col_values=(('qos', UUID('b35451ae-2b1e-4eb7-b41c-82c1d4bf7d95')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a8ed156-52, col_values=(('external_ids', {'iface-id': '3a8ed156-52bd-44e0-b5c3-e149acfab6c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5c:6f', 'vm-uuid': '7ba0b8d8-e743-40ec-9c7d-5656055b0b43'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: INFO os_vif [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6588b659-35, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6588b659-35, col_values=(('qos', UUID('30e13c62-ea1c-4798-98c6-ef025e082232')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6588b659-35, col_values=(('external_ids', {'iface-id': '6588b659-358d-40ed-9176-a98946d4cc7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c8:d0', 'vm-uuid': '8e38220a-0fa9-4c33-a344-c421d3bfb638'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:10 user nova-compute[75021]: INFO os_vif [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] No VIF found with MAC fa:16:3e:9e:fb:b2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No VIF found with MAC fa:16:3e:ba:5c:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] No VIF found with MAC fa:16:3e:9b:5c:6f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No VIF found with MAC fa:16:3e:82:c8:d0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updated VIF entry in instance network info cache for port 41865556-22cf-4324-9f33-7fe485aefed0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updating instance_info_cache with network_info: [{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b789bcc4-1487-4c15-b9af-7276259e10a5 req-a1c5a0bf-35f5-4b13-a252-34f3bbf0570f service nova] Releasing lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updated VIF entry in instance network info cache for port 6588b659-358d-40ed-9176-a98946d4cc7c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e987592d-75f8-4952-b089-af5bbe87c828 req-702778ea-5108-4ac5-b14e-40de0f599837 service nova] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:16 user nova-compute[75021]: INFO nova.compute.claims [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Claim successful on node user Nov 30 06:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.policy [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e03c0fb72598413b81c9da1d6e8b32e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030319f0557410c860f416b508c2883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Creating image(s) Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "/opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "/opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "/opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.035s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance spawned successfully. Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.273s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Took 17.57 seconds to spawn the instance on the hypervisor. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.234s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk 1073741824" returned: 0 in 0.085s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Took 18.98 seconds to build instance. Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.331s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bc29a787-dace-490e-ad87-dd27524b6d79 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.629s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Instance spawned successfully. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.378s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Instance spawned successfully. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Took 14.52 seconds to spawn the instance on the hypervisor. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance spawned successfully. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Took 15.70 seconds to build instance. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Took 17.77 seconds to spawn the instance on the hypervisor. Nov 30 06:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7ca07403-a7b6-45d9-a9eb-2a799493f0f7 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.875s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.375s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Cannot resize image /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Ensure instance console log exists: /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:19 user nova-compute[75021]: INFO nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Took 17.51 seconds to spawn the instance on the hypervisor. Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:19 user nova-compute[75021]: INFO nova.compute.manager [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Took 19.38 seconds to build instance. Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Successfully created port: 9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d711b07b-d227-4a5a-be3d-2c43fe7dce17 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.578s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:19 user nova-compute[75021]: INFO nova.compute.manager [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Took 19.35 seconds to build instance. Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3c05a179-b0c1-4c91-8e71-909a6dbdb142 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.561s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received event network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] Acquiring lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] No waiting events found dispatching network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:19 user nova-compute[75021]: WARNING nova.compute.manager [req-d174fed8-5c6f-4661-9847-2b74f40447f0 req-d596e893-ce12-4b0c-b626-ebb1773bd0f2 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received unexpected event network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 for instance with vm_state active and task_state None. Nov 30 06:28:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Successfully updated port: 9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquired lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-changed-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Refreshing instance network info cache due to event network-changed-9c696cbf-a571-4dc0-8706-f6226b0a28b8. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] Acquiring lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating instance_info_cache with network_info: [{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Releasing lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Instance network_info: |[{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] Acquired lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Refreshing network info cache for port 9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Start _get_guest_xml network_info=[{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2079750467',display_name='tempest-VolumesAdminNegativeTest-server-2079750467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2079750467',id=5,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYFjh/C6H20O+Vry84XGMyzhsk57im2TYFFdrdP71AZg4WcBLbrppu5iHDLegBB87iFdHLDLxMiqNWAH6CBnZ9RKKYzYQKp1Fiw4tkbT1jbIENtRd4XsV3VxMKyy7k47g==',key_name='tempest-keypair-1392797650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-7dojkdgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=93976999-56e9-46f0-bf87-ef5b794f7a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'pci_devices' on Instance uuid 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received event network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Acquiring lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] No waiting events found dispatching network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:22 user nova-compute[75021]: WARNING nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received unexpected event network-vif-plugged-41865556-22cf-4324-9f33-7fe485aefed0 for instance with vm_state active and task_state None. Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] No waiting events found dispatching network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:22 user nova-compute[75021]: WARNING nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received unexpected event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 for instance with vm_state active and task_state None. Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] No waiting events found dispatching network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:22 user nova-compute[75021]: WARNING nova.compute.manager [req-c90c3d27-f634-4455-996e-cd591b2b28b7 req-29a82d15-ca7d-47f6-9376-d63bb67a33ca service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received unexpected event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 for instance with vm_state active and task_state None. Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] End _get_guest_xml xml= Nov 30 06:28:22 user nova-compute[75021]: 93976999-56e9-46f0-bf87-ef5b794f7a38 Nov 30 06:28:22 user nova-compute[75021]: instance-00000005 Nov 30 06:28:22 user nova-compute[75021]: 524288 Nov 30 06:28:22 user nova-compute[75021]: 1 Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-server-2079750467 Nov 30 06:28:22 user nova-compute[75021]: 2023-11-30 06:28:21 Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: 512 Nov 30 06:28:22 user nova-compute[75021]: 1 Nov 30 06:28:22 user nova-compute[75021]: 0 Nov 30 06:28:22 user nova-compute[75021]: 0 Nov 30 06:28:22 user nova-compute[75021]: 1 Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-197033440-project-member Nov 30 06:28:22 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-197033440 Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:22 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:22 user nova-compute[75021]: 0.0.0 Nov 30 06:28:22 user nova-compute[75021]: 93976999-56e9-46f0-bf87-ef5b794f7a38 Nov 30 06:28:22 user nova-compute[75021]: 93976999-56e9-46f0-bf87-ef5b794f7a38 Nov 30 06:28:22 user nova-compute[75021]: Virtual Machine Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: hvm Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nehalem Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: /dev/urandom Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: Nov 30 06:28:22 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2079750467',display_name='tempest-VolumesAdminNegativeTest-server-2079750467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2079750467',id=5,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYFjh/C6H20O+Vry84XGMyzhsk57im2TYFFdrdP71AZg4WcBLbrppu5iHDLegBB87iFdHLDLxMiqNWAH6CBnZ9RKKYzYQKp1Fiw4tkbT1jbIENtRd4XsV3VxMKyy7k47g==',key_name='tempest-keypair-1392797650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-7dojkdgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=93976999-56e9-46f0-bf87-ef5b794f7a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG os_vif [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7d0c193-40a1-5f76-a4d0-a7653ccd11fb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c696cbf-a5, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c696cbf-a5, col_values=(('qos', UUID('0ea035ee-0192-455a-b72e-c7bd739ddb10')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c696cbf-a5, col_values=(('external_ids', {'iface-id': '9c696cbf-a571-4dc0-8706-f6226b0a28b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f7:4b', 'vm-uuid': '93976999-56e9-46f0-bf87-ef5b794f7a38'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: INFO os_vif [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No VIF found with MAC fa:16:3e:04:f7:4b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updated VIF entry in instance network info cache for port 9c696cbf-a571-4dc0-8706-f6226b0a28b8. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating instance_info_cache with network_info: [{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-91d15104-18a4-4be6-a55e-c52458bb988b req-7c9c011c-0224-4c5b-b93d-e23bb4aa113d service nova] Releasing lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] No waiting events found dispatching network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:24 user nova-compute[75021]: WARNING nova.compute.manager [req-2be7cfd5-5470-452b-af53-0b09fc6a42e9 req-b5f312cc-12f2-4e58-84c2-c81b9eba51c5 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received unexpected event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 for instance with vm_state building and task_state spawning. Nov 30 06:28:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] No waiting events found dispatching network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:26 user nova-compute[75021]: WARNING nova.compute.manager [req-d4b310bd-c52a-4a58-934c-bb940941ad75 req-65f47461-f888-45cc-901b-35743c35c0bc service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received unexpected event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 for instance with vm_state building and task_state spawning. Nov 30 06:28:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Instance spawned successfully. Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:27 user nova-compute[75021]: INFO nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Took 9.78 seconds to spawn the instance on the hypervisor. Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:27 user nova-compute[75021]: INFO nova.compute.manager [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Took 10.85 seconds to build instance. Nov 30 06:28:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e8e97756-d06a-4c03-8dbc-b708b12fcd35 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 10.991s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:27 user nova-compute[75021]: INFO nova.compute.claims [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Claim successful on node user Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:28 user nova-compute[75021]: DEBUG nova.policy [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11527b4789a0455bb1221ad3260c5840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c597d5b6050c481792ed86915f2a32c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Creating image(s) Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "/opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "/opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "/opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.310s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.268s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk 1073741824" returned: 0 in 0.085s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.360s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Successfully created port: 5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:30 user nova-compute[75021]: INFO nova.compute.claims [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Claim successful on node user Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Cannot resize image /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Ensure instance console log exists: /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.policy [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d5c909cac904290b8ed4c6d8d2b8c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4f2d5e25154b3b86bd047cc784bbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Creating image(s) Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "/opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "/opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Successfully updated port: 5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquired lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-changed-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Refreshing instance network info cache due to event network-changed-5a09b55c-24da-4b37-9566-3a40a2f25619. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] Acquiring lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.327s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk 1073741824" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Releasing lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Instance network_info: |[{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] Acquired lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Refreshing network info cache for port 5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Start _get_guest_xml network_info=[{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-534843965',display_name='tempest-TestVolumeSwap-server-534843965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-534843965',id=6,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4ttP/cOL+3Q4vYSrFHZnfUQ+SnxRJ8yeZNZ04+NQsUCi92Qw4yZtXeojA2RPApBkog4MwCtvrdB1HD5ie5ZialUg4lOTkgIIZh1s48nRZj+ZBZwjJYGTgN5TfesegAhg==',key_name='tempest-keypair-222683311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c597d5b6050c481792ed86915f2a32c2',ramdisk_id='',reservation_id='r-4woyc6om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1764509351',owner_user_name='tempest-TestVolumeSwap-1764509351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11527b4789a0455bb1221ad3260c5840',uuid=e34d6b99-e3c6-4015-8e80-4d240a1301f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converting VIF {"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lazy-loading 'pci_devices' on Instance uuid e34d6b99-e3c6-4015-8e80-4d240a1301f3 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Cannot resize image /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Ensure instance console log exists: /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] End _get_guest_xml xml= Nov 30 06:28:32 user nova-compute[75021]: e34d6b99-e3c6-4015-8e80-4d240a1301f3 Nov 30 06:28:32 user nova-compute[75021]: instance-00000006 Nov 30 06:28:32 user nova-compute[75021]: 524288 Nov 30 06:28:32 user nova-compute[75021]: 1 Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: tempest-TestVolumeSwap-server-534843965 Nov 30 06:28:32 user nova-compute[75021]: 2023-11-30 06:28:31 Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: 512 Nov 30 06:28:32 user nova-compute[75021]: 1 Nov 30 06:28:32 user nova-compute[75021]: 0 Nov 30 06:28:32 user nova-compute[75021]: 0 Nov 30 06:28:32 user nova-compute[75021]: 1 Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: tempest-TestVolumeSwap-1764509351-project-member Nov 30 06:28:32 user nova-compute[75021]: tempest-TestVolumeSwap-1764509351 Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:32 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:32 user nova-compute[75021]: 0.0.0 Nov 30 06:28:32 user nova-compute[75021]: e34d6b99-e3c6-4015-8e80-4d240a1301f3 Nov 30 06:28:32 user nova-compute[75021]: e34d6b99-e3c6-4015-8e80-4d240a1301f3 Nov 30 06:28:32 user nova-compute[75021]: Virtual Machine Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: hvm Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nehalem Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: /dev/urandom Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: Nov 30 06:28:32 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-534843965',display_name='tempest-TestVolumeSwap-server-534843965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-534843965',id=6,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4ttP/cOL+3Q4vYSrFHZnfUQ+SnxRJ8yeZNZ04+NQsUCi92Qw4yZtXeojA2RPApBkog4MwCtvrdB1HD5ie5ZialUg4lOTkgIIZh1s48nRZj+ZBZwjJYGTgN5TfesegAhg==',key_name='tempest-keypair-222683311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c597d5b6050c481792ed86915f2a32c2',ramdisk_id='',reservation_id='r-4woyc6om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1764509351',owner_user_name='tempest-TestVolumeSwap-1764509351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11527b4789a0455bb1221ad3260c5840',uuid=e34d6b99-e3c6-4015-8e80-4d240a1301f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converting VIF {"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG os_vif [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffc3bc60-fb59-56a7-8f82-62a28ca9fc0b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a09b55c-24, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a09b55c-24, col_values=(('qos', UUID('32f7d576-25df-4342-a208-8422ca9a95f6')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a09b55c-24, col_values=(('external_ids', {'iface-id': '5a09b55c-24da-4b37-9566-3a40a2f25619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:8c:3f', 'vm-uuid': 'e34d6b99-e3c6-4015-8e80-4d240a1301f3'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:32 user nova-compute[75021]: INFO os_vif [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] No VIF found with MAC fa:16:3e:73:8c:3f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updated VIF entry in instance network info cache for port 5a09b55c-24da-4b37-9566-3a40a2f25619. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7f1b302-7b31-4f96-8dad-ebc7bffa63ce req-73fafbe8-0dfc-4244-8d10-6d97e4742dcd service nova] Releasing lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:32 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Successfully created port: 1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Successfully updated port: 1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquired lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-changed-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Refreshing instance network info cache due to event network-changed-1896fcd5-144b-4086-bed5-f69ce04f72eb. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] Acquiring lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] No waiting events found dispatching network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:34 user nova-compute[75021]: WARNING nova.compute.manager [req-95fa67d2-f092-47e9-a8ac-3590ec46c397 req-87f7632e-eee5-4ec3-b619-8071164709fc service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received unexpected event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 for instance with vm_state building and task_state spawning. Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updating instance_info_cache with network_info: [{"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Releasing lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Instance network_info: |[{"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] Acquired lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Refreshing network info cache for port 1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Start _get_guest_xml network_info=[{"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-186370772',display_name='tempest-VolumesAssistedSnapshotsTest-server-186370772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-186370772',id=7,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF2w6np4hIT+KoW6W8BOLz6Ez69YNIAIuW4Gxg6Pm0DCrzQ2A+/vd3GARqApY109P8N2Zb4vgrJ7A/MKt/Fau/en7A+yRTgqIJ3O88d7DRTpkiL+kWrNkH5ZnA9MgdUxg==',key_name='tempest-keypair-1539196602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4f2d5e25154b3b86bd047cc784bbe3',ramdisk_id='',reservation_id='r-avde5kri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1792907322',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1792907322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d5c909cac904290b8ed4c6d8d2b8c12',uuid=3c804836-9890-489d-a0bf-69db4121ea46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converting VIF {"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] End _get_guest_xml xml= Nov 30 06:28:34 user nova-compute[75021]: 3c804836-9890-489d-a0bf-69db4121ea46 Nov 30 06:28:34 user nova-compute[75021]: instance-00000007 Nov 30 06:28:34 user nova-compute[75021]: 524288 Nov 30 06:28:34 user nova-compute[75021]: 1 Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: tempest-VolumesAssistedSnapshotsTest-server-186370772 Nov 30 06:28:34 user nova-compute[75021]: 2023-11-30 06:28:34 Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: 512 Nov 30 06:28:34 user nova-compute[75021]: 1 Nov 30 06:28:34 user nova-compute[75021]: 0 Nov 30 06:28:34 user nova-compute[75021]: 0 Nov 30 06:28:34 user nova-compute[75021]: 1 Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: tempest-VolumesAssistedSnapshotsTest-1792907322-project-member Nov 30 06:28:34 user nova-compute[75021]: tempest-VolumesAssistedSnapshotsTest-1792907322 Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:34 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:34 user nova-compute[75021]: 0.0.0 Nov 30 06:28:34 user nova-compute[75021]: 3c804836-9890-489d-a0bf-69db4121ea46 Nov 30 06:28:34 user nova-compute[75021]: 3c804836-9890-489d-a0bf-69db4121ea46 Nov 30 06:28:34 user nova-compute[75021]: Virtual Machine Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: hvm Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nehalem Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: /dev/urandom Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: Nov 30 06:28:34 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-186370772',display_name='tempest-VolumesAssistedSnapshotsTest-server-186370772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-186370772',id=7,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF2w6np4hIT+KoW6W8BOLz6Ez69YNIAIuW4Gxg6Pm0DCrzQ2A+/vd3GARqApY109P8N2Zb4vgrJ7A/MKt/Fau/en7A+yRTgqIJ3O88d7DRTpkiL+kWrNkH5ZnA9MgdUxg==',key_name='tempest-keypair-1539196602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4f2d5e25154b3b86bd047cc784bbe3',ramdisk_id='',reservation_id='r-avde5kri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1792907322',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1792907322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d5c909cac904290b8ed4c6d8d2b8c12',uuid=3c804836-9890-489d-a0bf-69db4121ea46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converting VIF {"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG os_vif [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '756f0132-b4f3-5a7f-9d75-c62ee5d59677', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1896fcd5-14, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1896fcd5-14, col_values=(('qos', UUID('e40ba707-f0d5-4ad6-ad47-4bebe99e150d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1896fcd5-14, col_values=(('external_ids', {'iface-id': '1896fcd5-144b-4086-bed5-f69ce04f72eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:5b:00', 'vm-uuid': '3c804836-9890-489d-a0bf-69db4121ea46'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:35 user nova-compute[75021]: INFO os_vif [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') Nov 30 06:28:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] No VIF found with MAC fa:16:3e:ae:5b:00, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updated VIF entry in instance network info cache for port 1896fcd5-144b-4086-bed5-f69ce04f72eb. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updating instance_info_cache with network_info: [{"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-24f2a065-3531-4083-831b-ddb0e4686c71 req-43d6a44e-b078-4bb7-88d2-076ff763365b service nova] Releasing lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] No waiting events found dispatching network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:36 user nova-compute[75021]: WARNING nova.compute.manager [req-cc11426a-c684-4732-baed-d8356c805ecb req-d89da3a1-5c93-4959-a148-8d67da7f27df service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received unexpected event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 for instance with vm_state building and task_state spawning. Nov 30 06:28:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:36 user nova-compute[75021]: WARNING nova.compute.manager [req-bc69c58f-66a9-4d09-ba4a-e941141da264 req-c14ee06e-a94e-4efb-99db-efc509e8fd4f service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state active and task_state None. Nov 30 06:28:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Instance spawned successfully. Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:37 user nova-compute[75021]: INFO nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Took 8.80 seconds to spawn the instance on the hypervisor. Nov 30 06:28:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:37 user nova-compute[75021]: INFO nova.compute.manager [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Took 10.20 seconds to build instance. Nov 30 06:28:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94efed60-52fd-41a8-8c5f-688bb97a55ca tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 10.368s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] No waiting events found dispatching network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:38 user nova-compute[75021]: WARNING nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received unexpected event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb for instance with vm_state building and task_state spawning. Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] No waiting events found dispatching network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:38 user nova-compute[75021]: WARNING nova.compute.manager [req-b864efa5-73cb-430b-bb82-2d0f196281b8 req-0b74f4be-7f24-4d8c-aa8f-64e75fed3011 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received unexpected event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb for instance with vm_state building and task_state spawning. Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:38 user nova-compute[75021]: WARNING nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state active and task_state None. Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:38 user nova-compute[75021]: WARNING nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state None. Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:38 user nova-compute[75021]: WARNING nova.compute.manager [req-7bb10826-3bef-40cc-b51b-7866b7e05d56 req-3c1673da-dfb4-4591-9fc6-77d27cd58950 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state None. Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Instance spawned successfully. Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:39 user nova-compute[75021]: INFO nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Took 8.73 seconds to spawn the instance on the hypervisor. Nov 30 06:28:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:39 user nova-compute[75021]: INFO nova.compute.manager [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Took 9.88 seconds to build instance. Nov 30 06:28:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94419f68-74ec-4bb9-9f36-bcc2fae1c9fb tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 10.088s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Cleaning up deleted instances with incomplete migration {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}} Nov 30 06:28:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:28:46 user nova-compute[75021]: INFO nova.compute.claims [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Claim successful on node user Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:28:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.policy [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '313d843645224dcda978a7d073164fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702a309fe38746d9adf8319d7e851653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:28:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Creating image(s) Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "/opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "/opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.262s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk 1073741824" returned: 0 in 0.312s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.521s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.266s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Cannot resize image /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Ensure instance console log exists: /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Successfully created port: f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Successfully updated port: f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquired lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-changed-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Refreshing instance network info cache due to event network-changed-f8d8200a-e21d-459d-ad98-ee9267c5d1a1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] Acquiring lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Updating instance_info_cache with network_info: [{"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Releasing lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Instance network_info: |[{"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] Acquired lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Refreshing network info cache for port f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Start _get_guest_xml network_info=[{"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:28:50 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:50 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1428372884',display_name='tempest-VolumesActionsTest-instance-1428372884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1428372884',id=8,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='702a309fe38746d9adf8319d7e851653',ramdisk_id='',reservation_id='r-nft7ew3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1797407968',owner_user_name='tempest-VolumesActionsTest-1797407968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:48Z,user_data=None,user_id='313d843645224dcda978a7d073164fe3',uuid=ca87c23c-e358-4472-9927-eaae616dfb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converting VIF {"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lazy-loading 'pci_devices' on Instance uuid ca87c23c-e358-4472-9927-eaae616dfb44 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] End _get_guest_xml xml= Nov 30 06:28:50 user nova-compute[75021]: ca87c23c-e358-4472-9927-eaae616dfb44 Nov 30 06:28:50 user nova-compute[75021]: instance-00000008 Nov 30 06:28:50 user nova-compute[75021]: 524288 Nov 30 06:28:50 user nova-compute[75021]: 1 Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: tempest-VolumesActionsTest-instance-1428372884 Nov 30 06:28:50 user nova-compute[75021]: 2023-11-30 06:28:50 Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: 512 Nov 30 06:28:50 user nova-compute[75021]: 1 Nov 30 06:28:50 user nova-compute[75021]: 0 Nov 30 06:28:50 user nova-compute[75021]: 0 Nov 30 06:28:50 user nova-compute[75021]: 1 Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: tempest-VolumesActionsTest-1797407968-project-member Nov 30 06:28:50 user nova-compute[75021]: tempest-VolumesActionsTest-1797407968 Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: OpenStack Foundation Nov 30 06:28:50 user nova-compute[75021]: OpenStack Nova Nov 30 06:28:50 user nova-compute[75021]: 0.0.0 Nov 30 06:28:50 user nova-compute[75021]: ca87c23c-e358-4472-9927-eaae616dfb44 Nov 30 06:28:50 user nova-compute[75021]: ca87c23c-e358-4472-9927-eaae616dfb44 Nov 30 06:28:50 user nova-compute[75021]: Virtual Machine Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: hvm Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nehalem Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: /dev/urandom Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: Nov 30 06:28:50 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1428372884',display_name='tempest-VolumesActionsTest-instance-1428372884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1428372884',id=8,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='702a309fe38746d9adf8319d7e851653',ramdisk_id='',reservation_id='r-nft7ew3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1797407968',owner_user_name='tempest-VolumesActionsTest-1797407968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:28:48Z,user_data=None,user_id='313d843645224dcda978a7d073164fe3',uuid=ca87c23c-e358-4472-9927-eaae616dfb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converting VIF {"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG os_vif [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56629127-1725-5ad3-b3b9-ac01a6450477', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8d8200a-e2, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8d8200a-e2, col_values=(('qos', UUID('19a585ba-b50f-49b0-8de0-05f26818bf9b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8d8200a-e2, col_values=(('external_ids', {'iface-id': 'f8d8200a-e21d-459d-ad98-ee9267c5d1a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:24:fa', 'vm-uuid': 'ca87c23c-e358-4472-9927-eaae616dfb44'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:50 user nova-compute[75021]: INFO os_vif [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] No VIF found with MAC fa:16:3e:e2:24:fa, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Updated VIF entry in instance network info cache for port f8d8200a-e21d-459d-ad98-ee9267c5d1a1. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Updating instance_info_cache with network_info: [{"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-00573d32-4ecf-478c-a37f-557d7b720801 req-70c59add-d036-42c7-bd21-4aae8501943a service nova] Releasing lock "refresh_cache-ca87c23c-e358-4472-9927-eaae616dfb44" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] No waiting events found dispatching network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:52 user nova-compute[75021]: WARNING nova.compute.manager [req-169181e2-f4d0-4c38-a621-811fc6ac225a req-e610f787-020a-4c76-aa26-3457ff599af6 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received unexpected event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 for instance with vm_state building and task_state spawning. Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:28:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] No waiting events found dispatching network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:28:55 user nova-compute[75021]: WARNING nova.compute.manager [req-2a16193b-e26c-462a-a0a8-c3e601ce4ffb req-b7d10b4d-57c9-478b-beda-aff2f34ce974 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received unexpected event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 for instance with vm_state building and task_state spawning. Nov 30 06:28:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=25.683883666992188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:28:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Instance spawned successfully. Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:28:55 user nova-compute[75021]: INFO nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Took 7.64 seconds to spawn the instance on the hypervisor. Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:28:55 user nova-compute[75021]: INFO nova.compute.manager [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Took 8.59 seconds to build instance. Nov 30 06:28:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f577869d-7ae0-46d0-994e-c47a37f2c9bc tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 8.770s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 3c804836-9890-489d-a0bf-69db4121ea46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance ca87c23c-e358-4472-9927-eaae616dfb44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing inventories for resource provider c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Updating ProviderTree inventory for provider c24a175c-4584-420f-87fd-9adb114da12c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Updating inventory in ProviderTree for provider c24a175c-4584-420f-87fd-9adb114da12c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing aggregate associations for resource provider c24a175c-4584-420f-87fd-9adb114da12c, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing trait associations for resource provider c24a175c-4584-420f-87fd-9adb114da12c, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:28:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:28:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:28:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:28:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lazy-loading 'info_cache' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating instance_info_cache with network_info: [{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:28:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:29:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:29:10 user nova-compute[75021]: INFO nova.compute.claims [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Claim successful on node user Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:29:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:29:10 user nova-compute[75021]: INFO nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Booting with volume 6b06e0f3-647d-4d0b-b3c1-8c14250c18ea at /dev/vda Nov 30 06:29:10 user nova-compute[75021]: DEBUG nova.policy [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'febaf469d3da47f783cd9bce4222bce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53c0cc2115432fb10cd702376e67c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:29:10 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:10 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpekpnry9j/privsep.sock'] Nov 30 06:29:10 user sudo[86215]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpekpnry9j/privsep.sock Nov 30 06:29:10 user sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Nov 30 06:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully created port: 28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully created port: 94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:12 user sudo[86215]: pam_unix(sudo:session): session closed for user root Nov 30 06:29:12 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Spawned new privsep daemon via rootwrap Nov 30 06:29:12 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 30 06:29:12 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 30 06:29:12 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none Nov 30 06:29:12 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86220 Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[81befcb5-083e-44dc-b3b5-ef5dbac04f29]: (2,) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b9559-df48-4738-8c6f-6e3c211ea4d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: WARNING os_brick.initiator.connectors.nvmeof [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b2ade-5017-4e81-86e0-5781b1d24ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489c956-627a-4a12-98ff-2e005a430c7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[095555c4-010b-4f53-81fa-f437bcefb673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:12 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:29:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d797922-44ff-41f6-a2c4-397377f769a5]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== get_connector_properties: return (1984ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating existing volume attachment record: 4f6b08ed-eabc-4ceb-8465-91f84fe96823 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully created port: 63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully created port: b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully created port: 34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: 28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-28cbcb37-bac8-497e-8bc7-d3bd98950107. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16b759db-8a59-4b08-9f97-b171c432210a req-143e3202-4201-4006-a9a8-788d637a9250 service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: 04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: 94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-b3b57faf-dbe2-47e9-910f-2fbaea438917. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-04a8c606-82dd-409b-bb94-f2398a53aa63. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: 63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-94abc8f8-62bb-4a78-91e5-f776f538e0a8. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b14a9ac1-5115-4bc7-b882-73d4ed3531dd req-05b85522-7f46-446b-ab9a-3467e622cbdb service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-63b91d81-71d3-4bd8-9c0a-7242523cf7d8. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Successfully updated port: 34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-b6df2f0a-49b5-4ca3-ad6b-6987f8396264. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4a716f19-11f1-4f9d-9ae1-f91e7d45a7fa req-f6d57bf9-8d3c-437b-9885-619947158cfd service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:29:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:21 user nova-compute[75021]: INFO nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Booting with volume 9f56b9d4-fcdb-4298-9fac-532fea09b702 at /dev/vdb Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c50329-5b2f-4d99-8de8-a9bf1c62047e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29da3b8b-cdc7-47ea-98b5-bd919611dbd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6facaa77-c3a4-4fe0-a33f-0edbf680f48e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217a7a3-797e-4f14-a5d8-f1f9aa56d73f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:21 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:29:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[757f7f87-8d31-43ea-9ebe-5eeb57db1118]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:21 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating existing volume attachment record: 19a80144-91d7-419b-a06a-bd9261c54d2d {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [{"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance network_info: |[{"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updated VIF entry in instance network info cache for port 34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [{"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e86c816-49f9-4d30-b85f-e990ca36e5e8 req-c8aa74b3-c5c2-4e98-8c0c-ff71da20c2d2 service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:30 user nova-compute[75021]: INFO nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Booting with volume 0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 at /dev/vdc Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7461bde2-d728-4aa1-8efd-92bf3507986e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aef1c3-0514-4f76-bb93-450ac52349aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0743a-af0e-4243-a38f-d7412ad9384a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a02834-5499-4de5-b7c4-bdda11d55dde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:30 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:29:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3971d-98f2-42fe-a440-0502141f6df4]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG os_brick.utils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating existing volume attachment record: 2c0108fe-df78-4511-912d-cc71e4c15317 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:29:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:29:35 user nova-compute[75021]: INFO nova.compute.claims [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Claim successful on node user Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:29:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.policy [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a7a8896ae7b4265aa37385aa71b470d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ae80ead9b4608b5ecf5054d70865e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:29:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Creating image(s) Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "/opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "/opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "/opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk 1073741824" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.241s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Successfully created port: e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:29:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Cannot resize image /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Ensure instance console log exists: /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Successfully updated port: e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquired lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received event network-changed-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Refreshing instance network info cache due to event network-changed-e916b942-03d1-42b6-b8aa-a092e4419af1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] Acquiring lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:29:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updating instance_info_cache with network_info: [{"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Releasing lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Instance network_info: |[{"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] Acquired lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Refreshing network info cache for port e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Start _get_guest_xml network_info=[{"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:29:38 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:38 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1246409627',display_name='tempest-TestStampPattern-server-1246409627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1246409627',id=10,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+Y5ALIhhKR4M2yTQx/yWsRKdaMtTkkeMHx8QCJTJ763UDOjVxC1bHYSkNoRHp/Ep/ds88FbZXmdqEd/nr8gIaylencpleh8FHOf6KXXzZrhaVX3+0SrpCM7+Spj6IBA==',key_name='tempest-TestStampPattern-1630726288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ae80ead9b4608b5ecf5054d70865e',ramdisk_id='',reservation_id='r-r18f7qm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1491533737',owner_user_name='tempest-TestStampPattern-1491533737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:36Z,user_data=None,user_id='1a7a8896ae7b4265aa37385aa71b470d',uuid=b23fb096-817f-4e68-a725-91a7492c5f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converting VIF {"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=e916b942-03d1-42b6-b8aa-a092e4419af1,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape916b942-03') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'pci_devices' on Instance uuid b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] End _get_guest_xml xml= Nov 30 06:29:38 user nova-compute[75021]: b23fb096-817f-4e68-a725-91a7492c5f48 Nov 30 06:29:38 user nova-compute[75021]: instance-0000000a Nov 30 06:29:38 user nova-compute[75021]: 524288 Nov 30 06:29:38 user nova-compute[75021]: 1 Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: tempest-TestStampPattern-server-1246409627 Nov 30 06:29:38 user nova-compute[75021]: 2023-11-30 06:29:38 Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: 512 Nov 30 06:29:38 user nova-compute[75021]: 1 Nov 30 06:29:38 user nova-compute[75021]: 0 Nov 30 06:29:38 user nova-compute[75021]: 0 Nov 30 06:29:38 user nova-compute[75021]: 1 Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: tempest-TestStampPattern-1491533737-project-member Nov 30 06:29:38 user nova-compute[75021]: tempest-TestStampPattern-1491533737 Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: OpenStack Foundation Nov 30 06:29:38 user nova-compute[75021]: OpenStack Nova Nov 30 06:29:38 user nova-compute[75021]: 0.0.0 Nov 30 06:29:38 user nova-compute[75021]: b23fb096-817f-4e68-a725-91a7492c5f48 Nov 30 06:29:38 user nova-compute[75021]: b23fb096-817f-4e68-a725-91a7492c5f48 Nov 30 06:29:38 user nova-compute[75021]: Virtual Machine Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: hvm Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nehalem Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: /dev/urandom Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: Nov 30 06:29:38 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1246409627',display_name='tempest-TestStampPattern-server-1246409627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1246409627',id=10,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+Y5ALIhhKR4M2yTQx/yWsRKdaMtTkkeMHx8QCJTJ763UDOjVxC1bHYSkNoRHp/Ep/ds88FbZXmdqEd/nr8gIaylencpleh8FHOf6KXXzZrhaVX3+0SrpCM7+Spj6IBA==',key_name='tempest-TestStampPattern-1630726288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ae80ead9b4608b5ecf5054d70865e',ramdisk_id='',reservation_id='r-r18f7qm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1491533737',owner_user_name='tempest-TestStampPattern-1491533737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:36Z,user_data=None,user_id='1a7a8896ae7b4265aa37385aa71b470d',uuid=b23fb096-817f-4e68-a725-91a7492c5f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converting VIF {"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=e916b942-03d1-42b6-b8aa-a092e4419af1,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape916b942-03') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG os_vif [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=e916b942-03d1-42b6-b8aa-a092e4419af1,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape916b942-03') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17d3f789-ced9-59f1-82ab-c11d1341fb3a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape916b942-03, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape916b942-03, col_values=(('qos', UUID('a9edf735-2032-441b-a50c-c539ae4a1846')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape916b942-03, col_values=(('external_ids', {'iface-id': 'e916b942-03d1-42b6-b8aa-a092e4419af1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5c:9a', 'vm-uuid': 'b23fb096-817f-4e68-a725-91a7492c5f48'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:38 user nova-compute[75021]: INFO os_vif [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=e916b942-03d1-42b6-b8aa-a092e4419af1,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape916b942-03') Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No VIF found with MAC fa:16:3e:f5:5c:9a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updated VIF entry in instance network info cache for port e916b942-03d1-42b6-b8aa-a092e4419af1. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updating instance_info_cache with network_info: [{"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e25cd9c-f481-4317-a4a2-f25d8b2c2686 req-7a91f035-83b7-4b81-a451-49efd221f15c service nova] Releasing lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:29:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Creating image(s) Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Ensure instance console log exists: /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Start _get_guest_xml network_info=[{"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASOiHguf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bbecc65-35af-4492-a6ff-7072fceeba67', 'attached_at': '', 'detached_at': '', 'volume_id': '6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 'serial': '6b06e0f3-647d-4d0b-b3c1-8c14250c18ea'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4f6b08ed-eabc-4ceb-8465-91f84fe96823', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpwZemXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bbecc65-35af-4492-a6ff-7072fceeba67', 'attached_at': '', 'detached_at': '', 'volume_id': '9f56b9d4-fcdb-4298-9fac-532fea09b702', 'serial': '9f56b9d4-fcdb-4298-9fac-532fea09b702'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '19a80144-91d7-419b-a06a-bd9261c54d2d', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMGrbOQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bbecc65-35af-4492-a6ff-7072fceeba67', 'attached_at': '', 'detached_at': '', 'volume_id': '0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 'serial': '0b6d497a-efe7-4fa8-948b-1b66be7f3fa1'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2c0108fe-df78-4511-912d-cc71e4c15317', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:29:39 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:39 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connector [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Factory for ISCSI on None {{(pid=75021) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.007s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASOiHguf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:39 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d5e47-a84c-4223-92e6-b55670e3d301]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:29:39 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad7e2b-56bf-4dc1-a221-b16a769f80f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea] added Nov 30 06:29:39 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6b876-b377-4999-b3b3-29f1f19b7a18]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6b29b8-8fa0-4f83-95e8-83ae5129146a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASOiHguf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASOiHguf" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd19d56-4c4b-4ee3-ad45-5e702c149910]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASOiHguf'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac61b2-11e2-4a53-a052-9d181b3aa98e]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb925082-28ac-4e13-885e-0dde620ab5a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Nov 30 06:29:39 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Nov 30 06:29:39 user nova-compute[75021]: {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Nov 30 06:29:39 user nova-compute[75021]: Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3b423-e7d0-472a-ad7d-d79799ae37d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] Nov 30 06:29:39 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] successful. Nov 30 06:29:39 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1740ab1-b6ce-4ed3-9b75-f611d9a0e1af]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc646481-ac19-4fc3-8a8d-4288eaf8f494]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:39 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:39 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d66a54-8bf5-42da-ac18-e311cef2b6ad]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASOiHguf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:29:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received event network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] Lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] Lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] No waiting events found dispatching network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:40 user nova-compute[75021]: WARNING nova.compute.manager [req-ac7600af-7d9a-4ed0-a673-d0612c4038c4 req-49688727-06c0-4d54-8f74-ebaf139c01be service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received unexpected event network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 for instance with vm_state building and task_state spawning. Nov 30 06:29:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23666353639303564', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666353639303564', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpwZemXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:41 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4be9a6-f38b-47e7-9b6c-5dffce5a564e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:29:41 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05b0be-9230-4a51-b210-d890d04f22d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702] added Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc5cc7-89b0-4cd4-b15c-1a9634e61a2c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08129f-133e-4570-adf2-6a3cc3a30791]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpwZemXM {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpwZemXM" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ccae8-a787-495d-8326-05d521cdfcf0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fpwZemXM'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d649eef-3cde-4e6e-acc5-162fcf6abf3c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f0fe6-7534-46a0-9730-78ee43f50fc6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc48d22-fce9-4da8-b7f7-fc34246cbd77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] Nov 30 06:29:41 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] successful. Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b8421-d292-471a-b373-530a436f11fc]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e90bf1-d21c-4dbd-91ea-35c892d8e3e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:41 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:41 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000eb73-7ac5-4241-a7eb-0c61a291b355]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:29:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpwZemXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received event network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] Lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] Lock "b23fb096-817f-4e68-a725-91a7492c5f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] No waiting events found dispatching network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:42 user nova-compute[75021]: WARNING nova.compute.manager [req-1311413b-0580-44c6-b8e4-07b3adf5c8c5 req-3cca9ff3-35fc-4ec9-9005-d830d6822eb1 service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received unexpected event network-vif-plugged-e916b942-03d1-42b6-b8aa-a092e4419af1 for instance with vm_state building and task_state spawning. Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23635656530343261', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635656530343261', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMGrbOQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:42 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:42 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:29:42 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:29:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Instance spawned successfully. Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9737b-c87c-4e74-bbb4-98b4e3277502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:29:42 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7406658-16ef-4e02-b94d-959645317c2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1] added Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f46de-9b38-40ae-8d2f-fb17665f6902]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ba29b-e3f8-4bdd-8bbe-4538d7da1d9b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMGrbOQU {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: INFO nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Took 6.27 seconds to spawn the instance on the hypervisor. Nov 30 06:29:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMGrbOQU" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53178dba-3b2f-438c-99f3-ebece0bc778e]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMGrbOQU'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56c867-9924-4373-ae1f-8929a49dbf29]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfac28f-d1f8-496a-a35d-479e9e6de13a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: INFO nova.compute.manager [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Took 7.10 seconds to build instance. Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59acf47e-a85a-42ee-8ac6-9c9346b6fac5 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 7.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c13ff7-77c4-4ea7-8960-c62ced64f05d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] Nov 30 06:29:42 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] successful. Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63560b39-c848-45c5-ae7d-4fb571340d64]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb3614f-b1a3-43b1-b1ab-d963ae93a63e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:29:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e49a54-9473-4322-8681-1cd18d811b0b]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:29:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMGrbOQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26233386636373662', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233386636373662', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bbecc65-35af-4492-a6ff-7072fceeba67 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] End _get_guest_xml xml= Nov 30 06:29:43 user nova-compute[75021]: 5bbecc65-35af-4492-a6ff-7072fceeba67 Nov 30 06:29:43 user nova-compute[75021]: instance-00000009 Nov 30 06:29:43 user nova-compute[75021]: 524288 Nov 30 06:29:43 user nova-compute[75021]: 1 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: tempest-device-tagging-server-185908729 Nov 30 06:29:43 user nova-compute[75021]: 2023-11-30 06:29:39 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: 512 Nov 30 06:29:43 user nova-compute[75021]: 1 Nov 30 06:29:43 user nova-compute[75021]: 0 Nov 30 06:29:43 user nova-compute[75021]: 0 Nov 30 06:29:43 user nova-compute[75021]: 1 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: tempest-TaggedBootDevicesTest_v242-1193762124-project-member Nov 30 06:29:43 user nova-compute[75021]: tempest-TaggedBootDevicesTest_v242-1193762124 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: OpenStack Foundation Nov 30 06:29:43 user nova-compute[75021]: OpenStack Nova Nov 30 06:29:43 user nova-compute[75021]: 0.0.0 Nov 30 06:29:43 user nova-compute[75021]: 5bbecc65-35af-4492-a6ff-7072fceeba67 Nov 30 06:29:43 user nova-compute[75021]: 5bbecc65-35af-4492-a6ff-7072fceeba67 Nov 30 06:29:43 user nova-compute[75021]: Virtual Machine Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: hvm Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nehalem Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: 6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: 9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: 0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: /dev/urandom Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: Nov 30 06:29:43 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9816b0fc-d9f0-58d0-b1d0-e4a17810099f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28cbcb37-ba, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28cbcb37-ba, col_values=(('qos', UUID('2e5b0795-55f3-49dc-ab92-d65cc0f5e6b9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28cbcb37-ba, col_values=(('external_ids', {'iface-id': '28cbcb37-bac8-497e-8bc7-d3bd98950107', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:02:d5', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a023ac9-3194-505b-984b-e036170f7c22', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3b57faf-db, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3b57faf-db, col_values=(('qos', UUID('27b2c203-2995-49a7-a4cf-27fb53cdd6cb')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3b57faf-db, col_values=(('external_ids', {'iface-id': 'b3b57faf-dbe2-47e9-910f-2fbaea438917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:72:f9', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a705a945-402b-58ef-b637-190276525724', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04a8c606-82, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04a8c606-82, col_values=(('qos', UUID('ed013fc2-1a05-45fb-ac6a-26593bb9c901')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04a8c606-82, col_values=(('external_ids', {'iface-id': '04a8c606-82dd-409b-bb94-f2398a53aa63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:6d:79', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5af7df7a-f14f-5864-8d2e-ed27a8b99ee8', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94abc8f8-62, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94abc8f8-62, col_values=(('qos', UUID('815b46e2-9898-403a-a21a-43300b217e2d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94abc8f8-62, col_values=(('external_ids', {'iface-id': '94abc8f8-62bb-4a78-91e5-f776f538e0a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:50:27', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04ef3335-432a-58d8-a7b9-117d5b79a9bd', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63b91d81-71, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63b91d81-71, col_values=(('qos', UUID('3b433c32-7124-40c6-88ff-ffd4a314ad94')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63b91d81-71, col_values=(('external_ids', {'iface-id': '63b91d81-71d3-4bd8-9c0a-7242523cf7d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:d2:f0', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fadb34ee-81b9-555c-8e88-b1b235525cab', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6df2f0a-49, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6df2f0a-49, col_values=(('qos', UUID('2ff51cf5-21dc-456f-b5ee-2e39766256f0')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6df2f0a-49, col_values=(('external_ids', {'iface-id': 'b6df2f0a-49b5-4ca3-ad6b-6987f8396264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b0:8d', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62656b02-60fe-50d6-a5cf-98ac936924c7', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34a0a6c1-7f, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34a0a6c1-7f, col_values=(('qos', UUID('8eb147d7-efb6-489d-bdcc-17a8179c2ceb')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34a0a6c1-7f, col_values=(('external_ids', {'iface-id': '34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:fb:75', 'vm-uuid': '5bbecc65-35af-4492-a6ff-7072fceeba67'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:44 user nova-compute[75021]: INFO os_vif [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] No VIF found with MAC fa:16:3e:a7:02:d5, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] No VIF found with MAC fa:16:3e:3f:d2:f0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:29:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Using config drive Nov 30 06:29:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Creating config drive at /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67/disk.config Nov 30 06:29:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphi_2nom9 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphi_2nom9" returned: 0 in 0.055s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:46 user nova-compute[75021]: WARNING nova.compute.manager [req-35921eb9-cee8-44a2-9216-c792e42f4c6a req-0c7966d4-e874-4f9b-b875-dc4d88ecce95 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 for instance with vm_state building and task_state spawning. Nov 30 06:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:47 user nova-compute[75021]: WARNING nova.compute.manager [req-a2f3a771-cf44-486d-a44d-a677dee3d48b req-5aee1155-62db-4405-a2c7-dcdc23f15398 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 for instance with vm_state building and task_state spawning. Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:47 user nova-compute[75021]: WARNING nova.compute.manager [req-af51d181-2fd7-4265-b245-b57dd9252b7b req-a4d7f656-a014-4e71-9c25-a708b87217de service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 for instance with vm_state building and task_state spawning. Nov 30 06:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:48 user nova-compute[75021]: WARNING nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 for instance with vm_state building and task_state spawning. Nov 30 06:29:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:48 user nova-compute[75021]: WARNING nova.compute.manager [req-1031519e-ce06-4100-a005-b7c42466645c req-5e54a392-893d-4d8e-ad16-a6bab6b3ea58 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 for instance with vm_state building and task_state spawning. Nov 30 06:29:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-1dfe8902-dd11-41d9-9474-7a2b799291bc req-46a3fdd6-80ff-422f-9771-e5c8c0a03d4c service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:49 user nova-compute[75021]: WARNING nova.compute.manager [req-23503a57-7790-4b5b-b5b5-0c38865e6898 req-8fcc931a-aca0-4424-8803-e40f824c2f66 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 for instance with vm_state building and task_state spawning. Nov 30 06:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:50 user nova-compute[75021]: WARNING nova.compute.manager [req-eb5f567d-4a7a-4a69-ae8b-d8739d1102d4 req-21c4aa71-5c99-4961-a2e1-46ce67062cd4 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 for instance with vm_state building and task_state spawning. Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:29:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance spawned successfully. Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:29:51 user nova-compute[75021]: WARNING nova.compute.manager [req-bdf82853-7a4d-4500-a3e7-45641f5a6ad9 req-e6007fae-2908-4d9c-86ab-d76090ecb242 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 for instance with vm_state building and task_state spawning. Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:29:51 user nova-compute[75021]: INFO nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Took 11.97 seconds to spawn the instance on the hypervisor. Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:29:51 user nova-compute[75021]: INFO nova.compute.manager [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Took 41.47 seconds to build instance. Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-321fc149-3e27-4724-8872-36477c7d3504 tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 41.638s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-changed-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Refreshing instance network info cache due to event network-changed-1bb1058b-c894-4e0a-90f0-e55b835b8679. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] Acquiring lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] Acquired lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Refreshing network info cache for port 1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updated VIF entry in instance network info cache for port 1bb1058b-c894-4e0a-90f0-e55b835b8679. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating instance_info_cache with network_info: [{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c516c6d-bde1-4a79-a5e7-f1cb34d4137a req-82421da9-bc2c-4be5-986b-5718c25f5deb service nova] Releasing lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-changed-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Refreshing instance network info cache due to event network-changed-6588b659-358d-40ed-9176-a98946d4cc7c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Refreshing network info cache for port 6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updated VIF entry in instance network info cache for port 6588b659-358d-40ed-9176-a98946d4cc7c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a007274f-f52a-47ce-a832-f1e06094bc0a req-22161474-7948-4558-ae66-484b994a83d4 service nova] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lazy-loading 'flavor' on Instance uuid 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.129s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.068s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:54 user nova-compute[75021]: INFO nova.compute.manager [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Attaching volume 29f8787d-128b-4016-a332-11b782fd7777 to /dev/vdb Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:54 user nova-compute[75021]: INFO nova.compute.manager [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Attaching volume 482c363d-cfed-4540-bfe6-65d877a34c40 to /dev/vdb Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e888eef-9ff1-40b6-9f38-5505bd4349f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d3962-9c7e-4567-b80a-31385f66a092]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac56e7-c8cd-4678-baec-2a32a632a7ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcb2a3-4e73-4d85-8aac-3e11cf47b975]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d02eff2-440e-4198-a585-7ca62e7f92f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e83f5e-f880-457a-8b7e-695473222a96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bfb9a1-4bee-4ee3-9e3a-83e667e01a42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c19db-b3f2-40a0-acb8-583a020738c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:54 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e7603f-52ee-4ff3-83be-0ad83c22d173]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating existing volume attachment record: 1c111d2f-2835-4d8e-a890-85aa3698ca2e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:29:54 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797715a-3386-458f-bea8-42da83a7fbda]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updating existing volume attachment record: 411b5461-222a-440f-a2e3-3a7be119cc1d {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Received event network-changed-41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Refreshing instance network info cache due to event network-changed-41865556-22cf-4324-9f33-7fe485aefed0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] Acquiring lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] Acquired lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG nova.network.neutron [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Refreshing network info cache for port 41865556-22cf-4324-9f33-7fe485aefed0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:29:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updated VIF entry in instance network info cache for port 41865556-22cf-4324-9f33-7fe485aefed0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updating instance_info_cache with network_info: [{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7130MB free_disk=25.57989501953125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f79b99f2-b059-4acc-9513-07a80e01c053 req-7013a736-c620-4329-93b0-9b47d081c083 service nova] Releasing lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 3c804836-9890-489d-a0bf-69db4121ea46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance ca87c23c-e358-4472-9927-eaae616dfb44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 5bbecc65-35af-4492-a6ff-7072fceeba67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:29:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:29:57 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:29:57 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:29:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:29:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.999s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updating instance_info_cache with network_info: [{"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-7ba0b8d8-e743-40ec-9c7d-5656055b0b43" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:29:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:29:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:04 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ce2c7-d885-4263-b39f-dffefe25f629]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:04 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEpGhMNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e9a46-9e6b-495e-9e79-4e00268add75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40] added Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af04b07d-8598-4ca1-8bcc-fdaa23150349]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ff17e-8f22-409f-9740-99a2101001bf]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOGVuvRe {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOGVuvRe" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8fdf0-f7d4-4b3e-9485-c2b2002d0a54]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOGVuvRe'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6818f040-881c-44b3-a69d-1bf133839d88]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7efcb-df0b-4d68-b077-a93dc3db1c03]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b58bf8-0077-46f0-aede-33e5b72aa19a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] Nov 30 06:30:04 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful. Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aeb8ad-db96-4336-bea9-010631a14caa]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d51786-f454-4454-b74a-833e9c8deb6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f468b-a972-41ef-a5d1-e6a768a27027]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26239316664386539', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239316664386539', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.306s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:05 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a38cc-a7b2-4896-bece-5e8863a8ae79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:05 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] attach device xml: Nov 30 06:30:05 user nova-compute[75021]: Nov 30 06:30:05 user nova-compute[75021]: Nov 30 06:30:05 user nova-compute[75021]: Nov 30 06:30:05 user nova-compute[75021]: 482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:30:05 user nova-compute[75021]: Nov 30 06:30:05 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf9bf8-498a-493e-a3b6-34b6990eada2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777] added Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63fe07b-6b08-4256-bff5-57a962a5d57c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[832cd43f-3baa-4d24-a934-7822612e2415]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEpGhMNi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEpGhMNi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c7d16-edca-4586-9cd6-d9e9804bfcb9]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YEpGhMNi'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1935d28a-9815-4687-bc03-e60154ca43fd]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f482df-982f-442d-9664-06f780f15cb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb5faf-cdbc-43a6-8ab9-d9826580adf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] Nov 30 06:30:05 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] successful. Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f33968-16cf-41ad-82e5-9f58c1d74611]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4889f4e-f323-4845-8f4c-f0809beae91b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash) Nov 30 06:30:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e14bc5-0690-49d8-aafc-2d45006e7689]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEpGhMNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] No VIF found with MAC fa:16:3e:9e:fb:b2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-06acfe05-7619-4e32-931f-ddaeecd14290 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 11.934s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75021) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] <== connect_volume: return (2675ms) {'type': 'block', 'scsi_wwn': '26531633633636564', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633633636564', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lazy-loading 'flavor' on Instance uuid 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] attach device xml: Nov 30 06:30:06 user nova-compute[75021]: Nov 30 06:30:06 user nova-compute[75021]: Nov 30 06:30:06 user nova-compute[75021]: Nov 30 06:30:06 user nova-compute[75021]: 29f8787d-128b-4016-a332-11b782fd7777 Nov 30 06:30:06 user nova-compute[75021]: Nov 30 06:30:06 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.007s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:06 user nova-compute[75021]: WARNING nova.compute.manager [req-d4465ad5-8eb8-4673-bfa8-e965faa3a9c5 req-76e5be79-29ec-4ed5-9af1-b67fbe040b8e service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state active and task_state powering-off. Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] No VIF found with MAC fa:16:3e:9b:5c:6f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9fbdf6e6-b8d9-4a5f-8778-16bd0142a859 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 13.336s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-changed-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Refreshing instance network info cache due to event network-changed-9c696cbf-a571-4dc0-8706-f6226b0a28b8. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] Acquiring lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] Acquired lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.network.neutron [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Refreshing network info cache for port 9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:30:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance destroyed successfully. Nov 30 06:30:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:30:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ce8a5f25-900d-4dd2-b54d-dcc55f4fae27 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: held 1.311s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG nova.network.neutron [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updated VIF entry in instance network info cache for port 9c696cbf-a571-4dc0-8706-f6226b0a28b8. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG nova.network.neutron [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating instance_info_cache with network_info: [{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-715838c3-84e5-4d96-979f-2e9dec771da5 req-289f38d4-b2d7-42ea-9d2d-5297817e0312 service nova] Releasing lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:08 user nova-compute[75021]: INFO nova.compute.manager [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Terminating instance Nov 30 06:30:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:08 user nova-compute[75021]: WARNING nova.compute.manager [req-fd5189ff-3f74-4b6f-bd2d-3b10bbd74a1e req-feefb3fb-29d4-4c1b-aa8a-b516607f17b4 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state stopped and task_state None. Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-unplugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] No waiting events found dispatching network-vif-unplugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-unplugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Acquiring lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] No waiting events found dispatching network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:09 user nova-compute[75021]: WARNING nova.compute.manager [req-7975445c-5531-4bdf-b498-2f8bd5e34651 req-ced3bad1-12ec-4190-8cd8-a192383fc7f5 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received unexpected event network-vif-plugged-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 for instance with vm_state active and task_state deleting. Nov 30 06:30:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Instance destroyed successfully. Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lazy-loading 'resources' on Instance uuid 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1707127936',display_name='tempest-DeleteServersTestJSON-server-1707127936',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1707127936',id=2,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2023-11-30T06:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='98342e6fa562410cb1746992525f2fda',ramdisk_id='',reservation_id='r-6p19rda6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1072197748',owner_user_name='tempest-DeleteServersTestJSON-1072197748-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:28:19Z,user_data=None,user_id='f3b685eaadbd4993b544980bfdea9235',uuid=7ba0b8d8-e743-40ec-9c7d-5656055b0b43,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converting VIF {"id": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "address": "fa:16:3e:9b:5c:6f", "network": {"id": "dab4c45b-e676-4247-8d44-c76edf640f67", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1802871700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98342e6fa562410cb1746992525f2fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8ed156-52", "ovs_interfaceid": "3a8ed156-52bd-44e0-b5c3-e149acfab6c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_vif [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a8ed156-52, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b35451ae-2b1e-4eb7-b41c-82c1d4bf7d95) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:09 user nova-compute[75021]: INFO os_vif [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=3a8ed156-52bd-44e0-b5c3-e149acfab6c9,network=Network(dab4c45b-e676-4247-8d44-c76edf640f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8ed156-52') Nov 30 06:30:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEpGhMNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac12437-3ca4-4cb4-854b-3c32fb4ee5fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:30:09 user nova-compute[75021]: No targets found. Nov 30 06:30:09 user nova-compute[75021]: iSNS: Nov 30 06:30:09 user nova-compute[75021]: No targets found. Nov 30 06:30:09 user nova-compute[75021]: STATIC: Nov 30 06:30:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:30:09 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:09 user nova-compute[75021]: Iface Name: default Nov 30 06:30:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:30:09 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:09 user nova-compute[75021]: Iface Name: default Nov 30 06:30:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:30:09 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:09 user nova-compute[75021]: Iface Name: default Nov 30 06:30:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 Nov 30 06:30:09 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:09 user nova-compute[75021]: Iface Name: default Nov 30 06:30:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:30:09 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:09 user nova-compute[75021]: Iface Name: default Nov 30 06:30:09 user nova-compute[75021]: FIRMWARE: Nov 30 06:30:09 user nova-compute[75021]: No targets found. Nov 30 06:30:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:30:09 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:30:09 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b691473c-66b6-40ee-b30b-8ec1c31ceb7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f6c233-9029-4be9-a9fa-e18fbcffbe0f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 (non-flash) Nov 30 06:30:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Resulting device map defaultdict(. at 0x7f00006495a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce5060-ad77-4eb1-a367-641de11c5974]: (4, ('path checker states:\nup 5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27b7d9-a1b1-494f-9a33-e745e6975f0a]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9f4b9-07ec-4bcf-825f-fb4fa40dad75]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a54131-d11f-4ae9-a55c-61ffcd1f8528]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOedd8f61d-e1c63ced1a05c1f7', '/dev/disk/by-id/scsi-26531633633636564', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_edd8f61d') {{(pid=86220) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b4cc1-3599-4363-86d1-117d6c1a5c90]: (4, None) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d792c8-184d-4db2-a1bf-d77eb1af3e9f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f0a7d6-f00c-4024-97a4-72f03db4e438]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] Nov 30 06:30:10 user nova-compute[75021]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777, portal: 172.16.0.220,3260] successful. Nov 30 06:30:10 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29f8787d-128b-4016-a332-11b782fd7777 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4962d22-8803-46f6-972a-9a900611958e]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] <== disconnect_volume: return (337ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:30:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Deleting instance files /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43_del Nov 30 06:30:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Deletion of /opt/stack/data/nova/instances/7ba0b8d8-e743-40ec-9c7d-5656055b0b43_del complete Nov 30 06:30:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75021) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}} Nov 30 06:30:10 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] UEFI support detected Nov 30 06:30:10 user nova-compute[75021]: INFO nova.compute.manager [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Took 1.56 seconds to destroy the instance on the hypervisor. Nov 30 06:30:10 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:30:10 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:10 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Took 0.47 seconds to deallocate network for instance. Nov 30 06:30:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2abd523-245a-4dcd-9e56-6afd1d2f1578 req-cdf687e8-ded7-4ea9-80c5-9372fde243f1 service nova] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Received event network-vif-deleted-3a8ed156-52bd-44e0-b5c3-e149acfab6c9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:11 user nova-compute[75021]: INFO nova.compute.manager [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] [instance: 7ba0b8d8-e743-40ec-9c7d-5656055b0b43] Took 1.24 seconds to detach 1 volumes for instance. Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'flavor' on Instance uuid 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.075s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:12 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Deleted allocations for instance 7ba0b8d8-e743-40ec-9c7d-5656055b0b43 Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e090ebdd-6ea3-4149-af81-590e4cafb121 tempest-DeleteServersTestJSON-1072197748 tempest-DeleteServersTestJSON-1072197748-project-member] Lock "7ba0b8d8-e743-40ec-9c7d-5656055b0b43" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 3.884s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:12 user nova-compute[75021]: INFO nova.compute.manager [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Attaching volume 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 to /dev/vdb Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[691dd418-02cd-4b51-a7d0-6e3d7f7dd11a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f16825-6820-4d59-92b4-20bdf8aafd7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd19d7-c915-4500-add1-ebdc2e88dcd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe9813-36e4-475e-a30c-5c80e4b8b27f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:12 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:30:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb0072-5277-43cb-b246-4cb63c5ce3fb]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:12 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating existing volume attachment record: 2c0e8c6b-d8ee-4c67-9984-d628015c991f {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:30:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-changed-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Refreshing instance network info cache due to event network-changed-5a09b55c-24da-4b37-9566-3a40a2f25619. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] Acquiring lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] Acquired lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Refreshing network info cache for port 5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lazy-loading 'flavor' on Instance uuid e34d6b99-e3c6-4015-8e80-4d240a1301f3 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.098s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updated VIF entry in instance network info cache for port 5a09b55c-24da-4b37-9566-3a40a2f25619. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:19 user nova-compute[75021]: INFO nova.compute.manager [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Attaching volume 13bd13a6-b54c-454f-ac70-92768106f077 to /dev/vdb Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0de5bde5-3c17-49d7-9d30-254b55984a2e req-4224855b-725f-4b5e-9f99-826f1dd43748 service nova] Releasing lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.utils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0f057-9b1d-4861-bae5-013df1de5e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62c285-0bf3-4855-a45f-08d52328ef30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286e6ff-7f76-4ea5-a6d6-5de3596e87a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1cd4c-f9b2-44cf-8a13-0d84c9426de3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:19 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:30:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[36111816-e7e4-41c8-ae7b-7426a5736532]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG os_brick.utils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating existing volume attachment record: 84716294-0db3-4dde-ad20-bae1b71d1d36 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:30:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-changed-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Refreshing instance network info cache due to event network-changed-1896fcd5-144b-4086-bed5-f69ce04f72eb. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] Acquiring lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] Acquired lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:20 user nova-compute[75021]: DEBUG nova.network.neutron [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Refreshing network info cache for port 1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lazy-loading 'flavor' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.088s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSDudshq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:21 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:21 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:21 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea4775e-e65b-425a-9470-75086b5d89d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:21 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ef380-e545-498a-8d1c-603fcd3c0739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30] added Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1072f457-086c-4ac7-b750-e4fa7983b761]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.091s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbd13f-197f-4ddb-a45c-71adde4bb74b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSDudshq {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updated VIF entry in instance network info cache for port 1896fcd5-144b-4086-bed5-f69ce04f72eb. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updating instance_info_cache with network_info: [{"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2ebf245-79bd-4df4-97f2-0e1b0d3087a1 req-b2d8a1fc-4992-454c-a2b5-b72a11a9ab7c service nova] Releasing lock "refresh_cache-3c804836-9890-489d-a0bf-69db4121ea46" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSDudshq" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90c96cb-5338-44bc-be6d-acfa2664ead7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSDudshq'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:21 user nova-compute[75021]: INFO nova.compute.manager [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Attaching volume c648e531-004e-44fd-8dc2-016aad1a0d14 to /dev/vdb Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.061s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a386c3-a5ef-4f3f-b1f2-1be1e7fd54fd]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a9eab-6fcb-49ce-839f-f60a78c1caf4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.utils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f138ce45-0bf4-4b18-9911-79dc29047887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] Nov 30 06:30:21 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] successful. Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22437bbd-adcd-4b0e-94d6-b042286ffd96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba06d4d-cc00-4961-9707-6de7587e0ea4]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb9f97-f90d-4bb6-998d-2cfc4ece6686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40655d-cf2f-421d-ae25-3072e5fe3d0d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:21 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b463c0-fcf4-43c7-bfb8-644630401e66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e07756-0526-476c-844d-474075e45d4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56fd930-90d5-469f-98b9-2783709220d2]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSDudshq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:21 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:30:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04793ac-d576-4346-93b1-cb4df154f8c3]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG os_brick.utils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:21 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updating existing volume attachment record: e322d871-9942-4a4d-a098-2cfe6fee2c8a {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:30:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '26438363634316633', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438363634316633', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'flavor' on Instance uuid 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] attach device xml: Nov 30 06:30:22 user nova-compute[75021]: Nov 30 06:30:22 user nova-compute[75021]: Nov 30 06:30:22 user nova-compute[75021]: Nov 30 06:30:22 user nova-compute[75021]: 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 Nov 30 06:30:22 user nova-compute[75021]: Nov 30 06:30:22 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:30:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No VIF found with MAC fa:16:3e:04:f7:4b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-329271f0-4524-40eb-aa5a-1c75f90d24b4 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.756s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:24 user nova-compute[75021]: INFO nova.compute.manager [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Detaching volume 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 Nov 30 06:30:24 user nova-compute[75021]: INFO nova.virt.block_device [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Attempting to driver detach volume 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 from mountpoint /dev/vdb Nov 30 06:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Attempting to detach device vdb from instance 93976999-56e9-46f0-bf87-ef5b794f7a38 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] detach device xml: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 Nov 30 06:30:24 user nova-compute[75021]:
Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:30:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully detached device vdb from instance 93976999-56e9-46f0-bf87-ef5b794f7a38 from the persistent domain config. Nov 30 06:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93976999-56e9-46f0-bf87-ef5b794f7a38 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] detach device xml: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: 8ccd356d-af0d-488c-b0ed-1bd99b0abd30 Nov 30 06:30:24 user nova-compute[75021]:
Nov 30 06:30:24 user nova-compute[75021]: Nov 30 06:30:24 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:30:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdHFmNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:28 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe28bcd-1d2f-4d3e-995c-3035b50922e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:28 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd27d04-f2ca-4aa4-bf88-cf651a12b52f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077] added Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16f751-8084-4e2b-ba15-a7ca09b2fa0b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e4904d-6634-46b7-883a-8bf1ad556ddf]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdHFmNCW {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdHFmNCW" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13bea8-ca23-4dc1-a210-32f8be66d47b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdHFmNCW'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0529f-2ffd-4c79-9c3e-ba2abcc0a169]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a138134-8388-4fb5-8d7e-9f14fa8bc71c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff099b-0981-4efc-ad44-45d3842607f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] Nov 30 06:30:28 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] successful. Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f97c9-1c2b-4980-b2fa-22515476ac05]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70fe663-f424-48a4-80a7-35ce13689b2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:28 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6e42e6-6fb7-4973-9474-517bc030ba1f]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdHFmNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26463613766326134', 'path': '/dev/sdg'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463613766326134', 'path': '/dev/sdg'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lazy-loading 'flavor' on Instance uuid e34d6b99-e3c6-4015-8e80-4d240a1301f3 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] attach device xml: Nov 30 06:30:29 user nova-compute[75021]: Nov 30 06:30:29 user nova-compute[75021]: Nov 30 06:30:29 user nova-compute[75021]: Nov 30 06:30:29 user nova-compute[75021]: 13bd13a6-b54c-454f-ac70-92768106f077 Nov 30 06:30:29 user nova-compute[75021]: Nov 30 06:30:29 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] No VIF found with MAC fa:16:3e:73:8c:3f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcVzNZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:30 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:30 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:30 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697820d-76fe-4c4b-a535-4e80294f9044]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:30 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2084932-d29e-4ff2-816b-0d6e88f4fb4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14] added Nov 30 06:30:30 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e94ce8-8194-4cb3-88df-67ee5e2180df]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[25087985-14d5-41b4-90a8-6192934ef396]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcVzNZPC {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcVzNZPC" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689e8a9-c4bc-41f4-bcc1-203b459ff057]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcVzNZPC'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-714cd37d-f931-472c-8bcd-db45d104e9df tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 11.738s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8f2b3-1d7d-44f9-94e7-da39b7eeabcf]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d35056f-156e-464d-ac57-6d081a6d8335]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcefe51a-54c0-41f1-ba3e-7e2240994d45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] Nov 30 06:30:31 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] successful. Nov 30 06:30:31 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a489711-76ac-4c11-baf8-4e5adb36ed15]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afb328c-5cff-45f7-af15-3fe754ad97a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:31 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ba03e-1f54-4412-a209-ecf6f8800719]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcVzNZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.utils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c0c76-47d6-432e-9c26-7c3a758037af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e099b11e-45d8-42a1-8a37-b7d4e96211c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c0b60-1bd9-4f12-90d0-215c5bb05f4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[602d34c0-ae76-4f0c-bf2c-98909ae98c04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:31 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:30:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f61a3-19c9-4f8b-a25b-da84160250ba]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:30:31 user nova-compute[75021]: DEBUG os_brick.utils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:32 user nova-compute[75021]: INFO nova.compute.manager [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Swapping volume 13bd13a6-b54c-454f-ac70-92768106f077 for f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:30:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23663623364346233', 'path': '/dev/sdh'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663623364346233', 'path': '/dev/sdh'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lazy-loading 'flavor' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] attach device xml: Nov 30 06:30:32 user nova-compute[75021]: Nov 30 06:30:32 user nova-compute[75021]: Nov 30 06:30:32 user nova-compute[75021]: Nov 30 06:30:32 user nova-compute[75021]: c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:32 user nova-compute[75021]: Nov 30 06:30:32 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] No VIF found with MAC fa:16:3e:ae:5b:00, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8497336b-2f6d-47db-886a-620c4b943164 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 11.494s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] volume_snapshot_create: create_info: {'snapshot_id': 'a53d77a7-baab-4d82-8ef5-8e3876000c1f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75021) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}} Nov 30 06:30:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] snap xml: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: Nov 30 06:30:33 user nova-compute[75021]: {{(pid=75021) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}} Nov 30 06:30:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] Lazy-loading 'system_metadata' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] self._domain.snapshotCreateXML(device_xml, flags=flags) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] result = proxy_call(self._autowrap, f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] rv = execute(f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] six.reraise(c, e, tb) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] raise value Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] rv = meth(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] raise libvirtError('virDomainSnapshotCreateXML() failed') Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] self._volume_snapshot_create(context, instance, guest, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] self._domain.snapshotCreateXML(device_xml, flags=flags) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] result = proxy_call(self._autowrap, f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] rv = execute(f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] six.reraise(c, e, tb) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] raise value Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] rv = meth(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] raise libvirtError('virDomainSnapshotCreateXML() failed') Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb299e53-116e-4d30-b2b5-b53613068509 tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] volume_snapshot_delete: delete_info: {'volume_id': 'c648e531-004e-44fd-8dc2-016aad1a0d14'} {{(pid=75021) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}} Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-cb299e53-116e-4d30-b2b5-b53613068509 tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] self._volume_snapshot_delete(context, instance, volume_id, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] if delete_info['type'] != 'qcow2': Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] KeyError: 'type' Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a53d77a7-baab-4d82-8ef5-8e3876000c1f could not be found. Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver result = proxy_call(self._autowrap, f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver rv = execute(f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver six.reraise(c, e, tb) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise value Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver rv = meth(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a53d77a7-baab-4d82-8ef5-8e3876000c1f could not be found. (HTTP 404) (Request-ID: req-63669594-e6ba-4e7a-9968-f38ef03eca62) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a53d77a7-baab-4d82-8ef5-8e3876000c1f could not be found. Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-cb299e53-116e-4d30-b2b5-b53613068509 tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver KeyError: 'type' Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-30412d0d-f059-42ae-aa98-e33e0a855a71) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Nov 30 06:30:34 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server [None req-26d805db-0de4-4667-bf76-3bd06937299e tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server result = proxy_call(self._autowrap, f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server rv = execute(f, *args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server six.reraise(c, e, tb) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise value Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server rv = meth(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server [None req-cb299e53-116e-4d30-b2b5-b53613068509 tempest-VolumesAssistedSnapshotsTest-1887901728 tempest-VolumesAssistedSnapshotsTest-1887901728-project] Exception during message handling: KeyError: 'type' Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server KeyError: 'type' Nov 30 06:30:34 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Nov 30 06:30:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:34 user nova-compute[75021]: INFO nova.compute.manager [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Detaching volume c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:34 user nova-compute[75021]: INFO nova.virt.block_device [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Attempting to driver detach volume c648e531-004e-44fd-8dc2-016aad1a0d14 from mountpoint /dev/vdb Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Attempting to detach device vdb from instance 3c804836-9890-489d-a0bf-69db4121ea46 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] detach device xml: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:34 user nova-compute[75021]:
Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:30:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Successfully detached device vdb from instance 3c804836-9890-489d-a0bf-69db4121ea46 from the persistent domain config. Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c804836-9890-489d-a0bf-69db4121ea46 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] detach device xml: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:34 user nova-compute[75021]:
Nov 30 06:30:34 user nova-compute[75021]: Nov 30 06:30:34 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:30:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:30:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:30:37 user nova-compute[75021]: INFO nova.compute.claims [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Claim successful on node user Nov 30 06:30:37 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:30:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.policy [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3f020560ef24aacb4faeefaf513150c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7adb9edd61405a8ea1c6ee7d5a1fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:30:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Creating image(s) Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "/opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "/opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk 1073741824" returned: 0 in 0.052s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.244s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Successfully created port: 45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.277s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Cannot resize image /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Successfully updated port: 45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquired lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-changed-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Refreshing instance network info cache due to event network-changed-45cc5eb4-5588-4c0a-806a-979fee73c91b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] Acquiring lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating instance_info_cache with network_info: [{"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Releasing lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Instance network_info: |[{"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] Acquired lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Refreshing network info cache for port 45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Start _get_guest_xml network_info=[{"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:30:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:30:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-790651217',display_name='tempest-TestServerVolumeAttachmentScenario-server-790651217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-790651217',id=11,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMumuLd/vivD1dUT4NZ3fJmWAgCv/IlGJtVe87z04aGcHMeSGeaG8IkaY9YU+RrpMqdMTABjKRXAa0s5WiT/qI8RQFS0psprqrGwFxIGxHzguKNLQgL52LL4LUoOWtPexw==',key_name='tempest-keypair-1085533526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7adb9edd61405a8ea1c6ee7d5a1fe7',ramdisk_id='',reservation_id='r-vg0pci6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804702332',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804702332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f020560ef24aacb4faeefaf513150c',uuid=f7b6383f-a916-400f-8424-54fbbffec7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converting VIF {"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'pci_devices' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] End _get_guest_xml xml= Nov 30 06:30:40 user nova-compute[75021]: f7b6383f-a916-400f-8424-54fbbffec7b8 Nov 30 06:30:40 user nova-compute[75021]: instance-0000000b Nov 30 06:30:40 user nova-compute[75021]: 524288 Nov 30 06:30:40 user nova-compute[75021]: 1 Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: tempest-TestServerVolumeAttachmentScenario-server-790651217 Nov 30 06:30:40 user nova-compute[75021]: 2023-11-30 06:30:40 Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: 512 Nov 30 06:30:40 user nova-compute[75021]: 1 Nov 30 06:30:40 user nova-compute[75021]: 0 Nov 30 06:30:40 user nova-compute[75021]: 0 Nov 30 06:30:40 user nova-compute[75021]: 1 Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: tempest-TestServerVolumeAttachmentScenario-1804702332-project-member Nov 30 06:30:40 user nova-compute[75021]: tempest-TestServerVolumeAttachmentScenario-1804702332 Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: OpenStack Foundation Nov 30 06:30:40 user nova-compute[75021]: OpenStack Nova Nov 30 06:30:40 user nova-compute[75021]: 0.0.0 Nov 30 06:30:40 user nova-compute[75021]: f7b6383f-a916-400f-8424-54fbbffec7b8 Nov 30 06:30:40 user nova-compute[75021]: f7b6383f-a916-400f-8424-54fbbffec7b8 Nov 30 06:30:40 user nova-compute[75021]: Virtual Machine Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: hvm Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nehalem Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: /dev/urandom Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: Nov 30 06:30:40 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-790651217',display_name='tempest-TestServerVolumeAttachmentScenario-server-790651217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-790651217',id=11,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMumuLd/vivD1dUT4NZ3fJmWAgCv/IlGJtVe87z04aGcHMeSGeaG8IkaY9YU+RrpMqdMTABjKRXAa0s5WiT/qI8RQFS0psprqrGwFxIGxHzguKNLQgL52LL4LUoOWtPexw==',key_name='tempest-keypair-1085533526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7adb9edd61405a8ea1c6ee7d5a1fe7',ramdisk_id='',reservation_id='r-vg0pci6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804702332',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804702332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f020560ef24aacb4faeefaf513150c',uuid=f7b6383f-a916-400f-8424-54fbbffec7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converting VIF {"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG os_vif [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7adcd8e2-0d5f-5f5e-97a9-4e6c2f89cc91', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45cc5eb4-55, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45cc5eb4-55, col_values=(('qos', UUID('a25e646f-ad64-42f1-9666-4071755666a7')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45cc5eb4-55, col_values=(('external_ids', {'iface-id': '45cc5eb4-5588-4c0a-806a-979fee73c91b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:6c:1a', 'vm-uuid': 'f7b6383f-a916-400f-8424-54fbbffec7b8'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:40 user nova-compute[75021]: INFO os_vif [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No VIF found with MAC fa:16:3e:26:6c:1a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updated VIF entry in instance network info cache for port 45cc5eb4-5588-4c0a-806a-979fee73c91b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating instance_info_cache with network_info: [{"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-354e9a23-e67d-44d6-acd8-124d892d8bb2 req-e6539fe7-89ea-4bfc-8e78-20ef87fcff21 service nova] Releasing lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFcgKWuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e34d6b99-e3c6-4015-8e80-4d240a1301f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'serial': 'f14d0071-45aa-4be2-b6f5-a7fa9cd108d6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdHFmNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e34d6b99-e3c6-4015-8e80-4d240a1301f3', 'attached_at': '', 'detached_at': '', 'volume_id': '13bd13a6-b54c-454f-ac70-92768106f077', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFcgKWuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:41 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b595733-7be8-466e-b53a-ef6ef4650de7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:30:41 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73158ce4-1057-4a36-a001-552a3f26cbee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6] added Nov 30 06:30:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c08b752-f025-4c3b-82b9-88bd5ccba164]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e854716-563a-49bf-95c3-a27f3fc8dd2f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XFcgKWuw {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XFcgKWuw" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17937be6-5c65-40ba-97d6-32fe9bde596c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XFcgKWuw'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4cdec8-296d-4ae0-8d15-9a5fb6a43103]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f466c-0492-497b-88b6-16ad7eb0c310]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4e215-cb26-4fed-af78-d5a465a32605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] Nov 30 06:30:42 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] successful. Nov 30 06:30:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc230cd-0873-41e9-848c-01e6fc2fc6b6]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243213e-51f9-4b12-9e8f-80f71c4e0785]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f23d25-fff2-4f96-a0a2-de6700178b11]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFcgKWuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] No waiting events found dispatching network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:42 user nova-compute[75021]: WARNING nova.compute.manager [req-51bd8acf-06a4-4930-9974-50e0b83893db req-20a23444-4644-4355-bade-be092f2aac7d service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received unexpected event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b for instance with vm_state building and task_state spawning. Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26261323362386431', 'path': '/dev/sdi'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261323362386431', 'path': '/dev/sdi'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:30:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lazy-loading 'flavor' on Instance uuid e34d6b99-e3c6-4015-8e80-4d240a1301f3 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] No waiting events found dispatching network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:44 user nova-compute[75021]: WARNING nova.compute.manager [req-9ba37b41-fdd3-4238-8c24-9387eb197862 req-2c92c39a-7330-491e-961e-8d5a0114f5eb service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received unexpected event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b for instance with vm_state building and task_state spawning. Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:30:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Instance spawned successfully. Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:30:44 user nova-compute[75021]: INFO nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Took 6.51 seconds to spawn the instance on the hypervisor. Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:30:44 user nova-compute[75021]: INFO nova.compute.manager [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Took 7.34 seconds to build instance. Nov 30 06:30:44 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 93976999-56e9-46f0-bf87-ef5b794f7a38 is timed out. Nov 30 06:30:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully detached device vdb from instance 93976999-56e9-46f0-bf87-ef5b794f7a38 from the live domain config. Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSDudshq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-218c82bc-d8a8-424a-8333-6ee0255f3638 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 7.440s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74077173-848f-4b10-afeb-605a65d92691]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:30:44 user nova-compute[75021]: No targets found. Nov 30 06:30:44 user nova-compute[75021]: iSNS: Nov 30 06:30:44 user nova-compute[75021]: No targets found. Nov 30 06:30:44 user nova-compute[75021]: STATIC: Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:30:44 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:44 user nova-compute[75021]: Iface Name: default Nov 30 06:30:44 user nova-compute[75021]: FIRMWARE: Nov 30 06:30:44 user nova-compute[75021]: No targets found. Nov 30 06:30:44 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:30:44 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:30:44 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f8a859-1551-42d2-9062-470963a0d45e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 268435456 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544efb5-838e-4336-ae60-489c39204086]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:45 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Resulting device map defaultdict(. at 0x7f00245dfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b6772-c2d3-4dd7-a3fb-f9e4115eed2a]: (4, ('path checker states:\nup 7\npending 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7091f-3516-4d11-8973-1560b1a1c9c5]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[513868c2-6d8d-4d6f-949f-b7a863dac880]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba21374-a887-45f9-a0a1-8ca5f16fcf57]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc729a8-0247-4e22-b75f-3c676089d3b1]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe3778e-eac9-4a98-9795-dbe76914cf0f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] Nov 30 06:30:45 user nova-compute[75021]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30, portal: 172.16.0.220,3260] successful. Nov 30 06:30:45 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ccd356d-af0d-488c-b0ed-1bd99b0abd30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3ecd2-2dd2-4fb2-9ced-f17cba045a3c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] <== disconnect_volume: return (490ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 535822336 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:46 user nova-compute[75021]: INFO nova.compute.manager [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Terminating instance Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 660602880 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-unplugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] No waiting events found dispatching network-vif-unplugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-ba0ae839-441a-4247-9ca5-3b319b0b1ace req-a57e4591-4360-4079-b36b-131a0cb6e7b4 service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-unplugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:30:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'flavor' on Instance uuid 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b472208f-689e-44f7-987b-dd410f710d9b tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.775s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 773849088 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Instance destroyed successfully. Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lazy-loading 'resources' on Instance uuid ca87c23c-e358-4472-9927-eaae616dfb44 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1428372884',display_name='tempest-VolumesActionsTest-instance-1428372884',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1428372884',id=8,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2023-11-30T06:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='702a309fe38746d9adf8319d7e851653',ramdisk_id='',reservation_id='r-nft7ew3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1797407968',owner_user_name='tempest-VolumesActionsTest-1797407968-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:28:55Z,user_data=None,user_id='313d843645224dcda978a7d073164fe3',uuid=ca87c23c-e358-4472-9927-eaae616dfb44,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converting VIF {"id": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "address": "fa:16:3e:e2:24:fa", "network": {"id": "b8277713-e278-4293-bd6f-43c2ee06c161", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016321313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "702a309fe38746d9adf8319d7e851653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d8200a-e2", "ovs_interfaceid": "f8d8200a-e21d-459d-ad98-ee9267c5d1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG os_vif [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8d8200a-e2, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19a585ba-b50f-49b0-8de0-05f26818bf9b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:47 user nova-compute[75021]: INFO os_vif [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:fa,bridge_name='br-int',has_traffic_filtering=True,id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1,network=Network(b8277713-e278-4293-bd6f-43c2ee06c161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d8200a-e2') Nov 30 06:30:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Deleting instance files /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44_del Nov 30 06:30:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Deletion of /opt/stack/data/nova/instances/ca87c23c-e358-4472-9927-eaae616dfb44_del complete Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 926941184 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:47 user nova-compute[75021]: INFO nova.compute.manager [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Took 1.11 seconds to destroy the instance on the hypervisor. Nov 30 06:30:47 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:30:47 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:48 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Took 0.57 seconds to deallocate network for instance. Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-acf1be09-4914-4d05-b0e1-2665c2d8c690 req-af294332-0600-40f4-a9d2-1fe068aae88a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-deleted-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:48 user nova-compute[75021]: INFO nova.compute.manager [req-acf1be09-4914-4d05-b0e1-2665c2d8c690 req-af294332-0600-40f4-a9d2-1fe068aae88a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Neutron deleted interface f8d8200a-e21d-459d-ad98-ee9267c5d1a1; detaching it from the instance and deleting it from the info cache Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-acf1be09-4914-4d05-b0e1-2665c2d8c690 req-af294332-0600-40f4-a9d2-1fe068aae88a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-acf1be09-4914-4d05-b0e1-2665c2d8c690 req-af294332-0600-40f4-a9d2-1fe068aae88a service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Detach interface failed, port_id=f8d8200a-e21d-459d-ad98-ee9267c5d1a1, reason: Instance ca87c23c-e358-4472-9927-eaae616dfb44 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdHFmNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:48 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bfaf69-339b-4601-a446-cf0be90e6a62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:30:48 user nova-compute[75021]: No targets found. Nov 30 06:30:48 user nova-compute[75021]: iSNS: Nov 30 06:30:48 user nova-compute[75021]: No targets found. Nov 30 06:30:48 user nova-compute[75021]: STATIC: Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:30:48 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:48 user nova-compute[75021]: Iface Name: default Nov 30 06:30:48 user nova-compute[75021]: FIRMWARE: Nov 30 06:30:48 user nova-compute[75021]: No targets found. Nov 30 06:30:48 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:30:48 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:30:48 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ace2b1-5ab4-4841-b060-ae2e5dbbebde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601ba51-56f4-458a-91f9-9d825cf9af13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:48 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Resulting device map defaultdict(. at 0x7f0000361ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077'): ({'sdg'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Removing single pathed devices sdg {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cae824-0eb0-432f-9072-fcc2e1e15155]: (4, ('path checker states:\nup 6\npending 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca70a415-3bd8-4dd3-aea7-b1ed3069d2fa]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Flushing IO for device /dev/sdg {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc2c75-e914-4e76-95ae-e85f34423193]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f88d7a-4252-48ae-9a71-cc932807461f]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2784afde-bad6-4d00-b7c4-c5b62211255a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53564375-ae08-49da-ad06-16eee48b357e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] Nov 30 06:30:48 user nova-compute[75021]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077, portal: 172.16.0.220,3260] successful. Nov 30 06:30:48 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bd13a6-b54c-454f-ac70-92768106f077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185232d-2530-48b8-9504-45bacca312f0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] <== disconnect_volume: return (394ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:48 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Deleted allocations for instance ca87c23c-e358-4472-9927-eaae616dfb44 Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFcgKWuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'e34d6b99-e3c6-4015-8e80-4d240a1301f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] swap_volume: removing Cinder connection for volume 13bd13a6-b54c-454f-ac70-92768106f077 {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b3d440fe-5875-40df-ada0-81a098b03a0b tempest-VolumesActionsTest-1797407968 tempest-VolumesActionsTest-1797407968-project-member] Lock "ca87c23c-e358-4472-9927-eaae616dfb44" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 2.352s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] Acquiring lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] Lock "ca87c23c-e358-4472-9927-eaae616dfb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] No waiting events found dispatching network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:30:48 user nova-compute[75021]: WARNING nova.compute.manager [req-38709789-7daf-4a36-bab5-6a57fb141fec req-45a3f729-7cc0-4bff-a1ce-2c973bea41bd service nova] [instance: ca87c23c-e358-4472-9927-eaae616dfb44] Received unexpected event network-vif-plugged-f8d8200a-e21d-459d-ad98-ee9267c5d1a1 for instance with vm_state deleted and task_state None. Nov 30 06:30:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] swap_volume: Updating volume 13bd13a6-b54c-454f-ac70-92768106f077 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XFcgKWuw", "auth_password": "Gpn9TevJlH1tPQ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "f14d0071-45aa-4be2-b6f5-a7fa9cd108d6"}, "status": "reserved", "instance": "e34d6b99-e3c6-4015-8e80-4d240a1301f3", "attached_at": "", "detached_at": "", "volume_id": "f14d0071-45aa-4be2-b6f5-a7fa9cd108d6", "serial": "f14d0071-45aa-4be2-b6f5-a7fa9cd108d6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'no_device': None, 'attachment_id': '94a36214-4839-4699-9011-e8a5aff2e253'} {{(pid=75021) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}} Nov 30 06:30:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c9e8568f-7ffb-466f-8c62-30e4cec3e112 tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" :: held 17.991s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.utils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a601f25-6e46-4de9-b8f9-c480b9e44c68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b9806d-56d3-4a9a-b264-cfab71fdea23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf883a-720e-4c7b-b171-44e624f8fe60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[939274fc-01c0-4f02-b436-c8e5a50b71c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:30:50 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:30:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[872aa11c-f447-430b-bd99-7892b95e7f79]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:30:50 user nova-compute[75021]: DEBUG os_brick.utils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:50 user nova-compute[75021]: INFO nova.compute.manager [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Swapping volume f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 for 13bd13a6-b54c-454f-ac70-92768106f077 Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:30:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c804836-9890-489d-a0bf-69db4121ea46 is timed out. Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.421s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Successfully detached device vdb from instance 3c804836-9890-489d-a0bf-69db4121ea46 from the live domain config. Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcVzNZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:30:55 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb948d5e-c995-4e32-a84a-1b7716a363e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:30:55 user nova-compute[75021]: No targets found. Nov 30 06:30:55 user nova-compute[75021]: iSNS: Nov 30 06:30:55 user nova-compute[75021]: No targets found. Nov 30 06:30:55 user nova-compute[75021]: STATIC: Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:30:55 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:30:55 user nova-compute[75021]: Iface Name: default Nov 30 06:30:55 user nova-compute[75021]: FIRMWARE: Nov 30 06:30:55 user nova-compute[75021]: No targets found. Nov 30 06:30:55 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:30:55 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:30:55 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:30:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.576454162597656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b742b-e5ac-4654-90e4-47ebcfb10ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a410eb-51c5-4a29-bff3-fe414fcba855]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 (non-flash) Nov 30 06:30:55 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Resulting device map defaultdict(. at 0x7f00181f6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14'): ({'sdh'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Removing single pathed devices sdh {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda17393-ee10-4bb1-93ca-020f36e337a9]: (4, ('path checker states:\nup 6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26ca0a-a3e4-43ad-afba-2fb20a4e9fde]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Flushing IO for device /dev/sdh {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a54eaa-a28f-46dc-aff3-1f68e1850d10]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 3c804836-9890-489d-a0bf-69db4121ea46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 5bbecc65-35af-4492-a6ff-7072fceeba67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance f7b6383f-a916-400f-8424-54fbbffec7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6365d41-13e0-4e57-9960-30569307933f]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d67df-b46a-4033-b671-227a719f13d7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a897ccd-5165-4637-97bc-9bee99bcb311]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] Nov 30 06:30:55 user nova-compute[75021]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14, portal: 172.16.0.220,3260] successful. Nov 30 06:30:55 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648e531-004e-44fd-8dc2-016aad1a0d14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5aabea-1084-43cd-9b27-233aee3391fb]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.868s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] <== disconnect_volume: return (871ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:30:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lazy-loading 'flavor' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-33934125-ca45-450a-bc0e-5cf4cf87ce15 tempest-VolumesAssistedSnapshotsTest-29408741 tempest-VolumesAssistedSnapshotsTest-29408741-project-admin] Lock "3c804836-9890-489d-a0bf-69db4121ea46" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.300s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.volume.cinder [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Update attachment failed for attachment 264f6da4-33d0-4390-8fbe-f8e303611542. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Failed to connect to volume 13bd13a6-b54c-454f-ac70-92768106f077 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Traceback (most recent call last): Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] old_cinfo, new_cinfo = self._init_volume_connection( Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] new_cinfo = self.volume_api.attachment_update( Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] res = method(self, ctx, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] res = method(self, ctx, attachment_id, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] with excutils.save_and_reraise_exception(): Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] self.force_reraise() Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] raise self.value Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] context, '3.44', skip_version_check=True).attachments.update( Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] return method.func(obj, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] resp = self._update('/attachments/%s' % id, body) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] resp, body = self.api.client.put(url, body=body, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] return self._cs_request(url, 'PUT', **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] return self.request(url, method, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] raise exceptions.from_response(resp, body) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Nov 30 06:30:57 user nova-compute[75021]: ERROR nova.compute.manager [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.swap_volume.._do_locked_swap_volume" :: held 6.568s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server [None req-77d23b8d-1f55-4509-9d10-6011796bd8ec tempest-TestVolumeSwap-1145247162 tempest-TestVolumeSwap-1145247162-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance, Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self._do_swap_volume(context, old_volume_id, new_volume_id, Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server comp_ret, new_cinfo = self._swap_volume(context, Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server old_cinfo, new_cinfo = self._init_volume_connection( Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server new_cinfo = self.volume_api.attachment_update( Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server res = method(self, ctx, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server res = method(self, ctx, attachment_id, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise self.value Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server context, '3.44', skip_version_check=True).attachments.update( Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return method.func(obj, *args, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server resp = self._update('/attachments/%s' % id, body) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server resp, body = self.api.client.put(url, body=body, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return self._cs_request(url, 'PUT', **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server return self.request(url, method, **kwargs) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server raise exceptions.from_response(resp, body) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78cbf4e3-0e4d-4b51-9520-b158900f79d8) Nov 30 06:30:57 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Nov 30 06:30:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:30:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:31:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-changed-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing instance network info cache due to event network-changed-28cbcb37-bac8-497e-8bc7-d3bd98950107. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] Acquiring lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] Acquired lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Refreshing network info cache for port 28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updated VIF entry in instance network info cache for port 28cbcb37-bac8-497e-8bc7-d3bd98950107. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:31:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [{"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155e3e20-65db-4757-a302-ef859c2d8ce1 req-455cdc2c-7e76-4479-ae72-ceb0e8ee5c51 service nova] Releasing lock "refresh_cache-5bbecc65-35af-4492-a6ff-7072fceeba67" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:03 user nova-compute[75021]: INFO nova.compute.manager [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Terminating instance Nov 30 06:31:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-133dd22e-100d-4c03-90a1-8c149ae1eb6a req-d92e7704-603a-45f8-bf9b-1c9817d57d74 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-add5f943-74a8-4ca2-b344-5e820748e1ea req-c7368857-d019-4291-bb27-9c67aafe9e39 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-41cec148-3ef9-42ab-a38e-e956de954176 req-6da39eae-41b9-4ab8-8ed4-7f9769566759 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Instance destroyed successfully. Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lazy-loading 'resources' on Instance uuid 5bbecc65-35af-4492-a6ff-7072fceeba67 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "address": "fa:16:3e:a7:02:d5", "network": {"id": "e4ba744e-c761-4949-84fc-869420eef640", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1260634690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cbcb37-ba", "ovs_interfaceid": "28cbcb37-bac8-497e-8bc7-d3bd98950107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28cbcb37-ba, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e5b0795-55f3-49dc-ab92-d65cc0f5e6b9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:d5,bridge_name='br-int',has_traffic_filtering=True,id=28cbcb37-bac8-497e-8bc7-d3bd98950107,network=Network(e4ba744e-c761-4949-84fc-869420eef640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cbcb37-ba') Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3b57faf-db, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27b2c203-2995-49a7-a4cf-27fb53cdd6cb) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3b57faf-dbe2-47e9-910f-2fbaea438917,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3b57faf-db') Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04a8c606-82, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed013fc2-1a05-45fb-ac6a-26593bb9c901) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=04a8c606-82dd-409b-bb94-f2398a53aa63,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04a8c606-82') Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94abc8f8-62, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=815b46e2-9898-403a-a21a-43300b217e2d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:50:27,bridge_name='br-int',has_traffic_filtering=True,id=94abc8f8-62bb-4a78-91e5-f776f538e0a8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc8f8-62') Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63b91d81-71, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b433c32-7124-40c6-88ff-ffd4a314ad94) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:f0,bridge_name='br-int',has_traffic_filtering=True,id=63b91d81-71d3-4bd8-9c0a-7242523cf7d8,network=Network(7d0374bd-891f-44f7-85c7-7dec568103de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b91d81-71') Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6df2f0a-49, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b3b57faf-dbe2-47e9-910f-2fbaea438917 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-04a8c606-82dd-409b-bb94-f2398a53aa63 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-04a8c606-82dd-409b-bb94-f2398a53aa63 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-572d0c8e-619a-4a42-be01-62210ebe1a47 req-42bfc238-f4d3-465d-bfaa-e30e905651c6 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff51cf5-21dc-456f-b5ee-2e39766256f0) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b0:8d,bridge_name='br-int',has_traffic_filtering=True,id=b6df2f0a-49b5-4ca3-ad6b-6987f8396264,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6df2f0a-49') Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185908729',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185908729',id=9,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/hZW7AvrlCmHXNrvMlujqFYl2iU08/aztcAaU3I7LipSqYOGcb089oVexoxmal/wdMuuaaNrWfBFXzqoa5jYzdJNC9PeIxCFDGvqZvFq/Z+NsfIkqRxCZ6jlNxzU/GAQ==',key_name='tempest-keypair-1278269842',keypairs=,launch_index=0,launched_at=2023-11-30T06:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da53c0cc2115432fb10cd702376e67c5',ramdisk_id='',reservation_id='r-s4vssrvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193762124',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193762124-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febaf469d3da47f783cd9bce4222bce6',uuid=5bbecc65-35af-4492-a6ff-7072fceeba67,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converting VIF {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34a0a6c1-7f, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eb147d7-efb6-489d-bdcc-17a8179c2ceb) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: INFO os_vif [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1,network=Network(7789bdcb-991b-4699-9328-64de7779faa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a0a6c1-7f') Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASOiHguf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d3900-035e-4bc2-ad62-a1b9d2a190e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: iSNS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: STATIC: Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: FIRMWARE: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:31:06 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-28cbcb37-bac8-497e-8bc7-d3bd98950107 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-ea74f254-a8ed-4b42-8616-6bd4b03aeb1b req-bd20dab9-3896-4c3b-879b-1cf669001f26 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee327aa2-86eb-4286-9619-6b47fe50f493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd8bb0-7a24-43d6-9e46-a526ba71afe2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Resulting device map defaultdict(. at 0x7f0000361e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e4e83-fc3b-4c25-8454-bc1f6a19d5bc]: (4, ('path checker states:\nup 5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6769c6bb-6029-4700-96b6-7f73aa544e23]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[78694a24-acc1-483f-b7c8-72ecfea4de97]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-94abc8f8-62bb-4a78-91e5-f776f538e0a8 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-unplugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-unplugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Acquiring lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] No waiting events found dispatching network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:06 user nova-compute[75021]: WARNING nova.compute.manager [req-440e4444-32bb-4f4f-a064-f6fac8308963 req-ad6a6c6c-20a6-4623-b160-67f3ad9f6ff0 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received unexpected event network-vif-plugged-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 for instance with vm_state active and task_state deleting. Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0fa32-1fe2-4222-a167-370d275a7e79]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c45ac7-152e-4b35-9f2b-7858e17efc42]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6fbe7-5d0c-4810-a7d2-185f7f3bf0d1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] Nov 30 06:31:06 user nova-compute[75021]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea, portal: 172.16.0.220,3260] successful. Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b06e0f3-647d-4d0b-b3c1-8c14250c18ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d0655-3ac9-4b80-88c4-498baf02e8d8]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== disconnect_volume: return (348ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpwZemXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4858ae84-05bc-4c7b-a911-8748e1b2e77b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: iSNS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: STATIC: Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: FIRMWARE: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:31:06 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[060881dd-b3e8-40cf-b51b-2b48f35bd8ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c412c88-3b12-4135-ac95-67a6efdaf4af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Resulting device map defaultdict(. at 0x7f0000361e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba043e-b80e-46a6-8fc8-d2952f574ac0]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a44075b-3cae-4a22-a85b-a4848329ebc8]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8cb557-508b-4411-8df0-4f975d93da8f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c6422c-a363-4fc2-8562-496a8efe80c9]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f69dfa1-5427-4ea5-b1da-351ed5ad0746]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ce02c-19ed-4d11-9beb-793af883f23d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] Nov 30 06:31:06 user nova-compute[75021]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702, portal: 172.16.0.220,3260] successful. Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56b9d4-fcdb-4298-9fac-532fea09b702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[344b9c4a-fb38-4de8-946d-64c7e0376c61]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== disconnect_volume: return (308ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMGrbOQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa92ded-d010-4560-b871-ac54ecdc47d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: iSNS: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: STATIC: Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:31:06 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:06 user nova-compute[75021]: Iface Name: default Nov 30 06:31:06 user nova-compute[75021]: FIRMWARE: Nov 30 06:31:06 user nova-compute[75021]: No targets found. Nov 30 06:31:06 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:31:06 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:31:06 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[588cc64a-c918-439b-91f9-3b88266e9668]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a42edd-9e86-4741-b1c5-ecd8c97d57d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:07 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Resulting device map defaultdict(. at 0x7f0000361e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd5cc4-f688-4760-bb4e-1380319fdb0f]: (4, ('path checker states:\nup 3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2d7e7-250c-4d29-95c9-220fdd0a68d4]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f610092-2c8a-4596-920c-88b3bf3575fd]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4daf5-71c2-45fe-ba75-84d6008723e3]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d53a20c-c6f2-4963-bcda-ac47ed1d478b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d647340-0f2f-4319-95f9-70438a992268]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] Nov 30 06:31:07 user nova-compute[75021]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1, portal: 172.16.0.220,3260] successful. Nov 30 06:31:07 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6d497a-efe7-4fa8-948b-1b66be7f3fa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d4afb-0f6a-48d3-9ffa-d25dcc4b0ea8]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] <== disconnect_volume: return (319ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:31:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Deleting instance files /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67_del Nov 30 06:31:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Deletion of /opt/stack/data/nova/instances/5bbecc65-35af-4492-a6ff-7072fceeba67_del complete Nov 30 06:31:07 user nova-compute[75021]: INFO nova.compute.manager [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Took 3.71 seconds to destroy the instance on the hypervisor. Nov 30 06:31:07 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:31:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-290d32db-324b-440d-be56-71833852ab42 req-3ef8183c-b02e-4050-ba7b-16d4a8ae36f9 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-deleted-28cbcb37-bac8-497e-8bc7-d3bd98950107 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:09 user nova-compute[75021]: INFO nova.compute.manager [req-290d32db-324b-440d-be56-71833852ab42 req-3ef8183c-b02e-4050-ba7b-16d4a8ae36f9 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Neutron deleted interface 28cbcb37-bac8-497e-8bc7-d3bd98950107; detaching it from the instance and deleting it from the info cache Nov 30 06:31:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-290d32db-324b-440d-be56-71833852ab42 req-3ef8183c-b02e-4050-ba7b-16d4a8ae36f9 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [{"id": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "address": "fa:16:3e:c2:72:f9", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b57faf-db", "ovs_interfaceid": "b3b57faf-dbe2-47e9-910f-2fbaea438917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04a8c606-82dd-409b-bb94-f2398a53aa63", "address": "fa:16:3e:77:6d:79", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a8c606-82", "ovs_interfaceid": "04a8c606-82dd-409b-bb94-f2398a53aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "address": "fa:16:3e:3e:50:27", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc8f8-62", "ovs_interfaceid": "94abc8f8-62bb-4a78-91e5-f776f538e0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "address": "fa:16:3e:3f:d2:f0", "network": {"id": "7d0374bd-891f-44f7-85c7-7dec568103de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1762750802", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b91d81-71", "ovs_interfaceid": "63b91d81-71d3-4bd8-9c0a-7242523cf7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "address": "fa:16:3e:08:b0:8d", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6df2f0a-49", "ovs_interfaceid": "b6df2f0a-49b5-4ca3-ad6b-6987f8396264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "address": "fa:16:3e:c1:fb:75", "network": {"id": "7789bdcb-991b-4699-9328-64de7779faa4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1390309157", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "da53c0cc2115432fb10cd702376e67c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a0a6c1-7f", "ovs_interfaceid": "34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-290d32db-324b-440d-be56-71833852ab42 req-3ef8183c-b02e-4050-ba7b-16d4a8ae36f9 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Detach interface failed, port_id=28cbcb37-bac8-497e-8bc7-d3bd98950107, reason: Instance 5bbecc65-35af-4492-a6ff-7072fceeba67 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:31:10 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:10 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Took 3.55 seconds to deallocate network for instance. Nov 30 06:31:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-be565c4e-c2df-4087-9b2e-d2227747c020 req-986c7129-2f1d-4480-80f5-c13c003e93b1 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-deleted-94abc8f8-62bb-4a78-91e5-f776f538e0a8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-be565c4e-c2df-4087-9b2e-d2227747c020 req-986c7129-2f1d-4480-80f5-c13c003e93b1 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-deleted-b6df2f0a-49b5-4ca3-ad6b-6987f8396264 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-be565c4e-c2df-4087-9b2e-d2227747c020 req-986c7129-2f1d-4480-80f5-c13c003e93b1 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-deleted-63b91d81-71d3-4bd8-9c0a-7242523cf7d8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-be565c4e-c2df-4087-9b2e-d2227747c020 req-986c7129-2f1d-4480-80f5-c13c003e93b1 service nova] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Received event network-vif-deleted-34a0a6c1-7fd4-4822-a81e-8814a6ebd8e1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:13 user nova-compute[75021]: INFO nova.compute.manager [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] [instance: 5bbecc65-35af-4492-a6ff-7072fceeba67] Took 2.66 seconds to detach 3 volumes for instance. Nov 30 06:31:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:13 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:14 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Deleted allocations for instance 5bbecc65-35af-4492-a6ff-7072fceeba67 Nov 30 06:31:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4d93667a-c4e9-43d3-a3fe-940f5bf6a8ea tempest-TaggedBootDevicesTest_v242-1193762124 tempest-TaggedBootDevicesTest_v242-1193762124-project-member] Lock "5bbecc65-35af-4492-a6ff-7072fceeba67" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.453s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:31:16 user nova-compute[75021]: INFO nova.compute.claims [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Claim successful on node user Nov 30 06:31:16 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:31:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.policy [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e03c0fb72598413b81c9da1d6e8b32e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030319f0557410c860f416b508c2883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:31:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Creating image(s) Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "/opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "/opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Successfully created port: 5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk 1073741824" returned: 0 in 0.049s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.247s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:31:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Cannot resize image /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Ensure instance console log exists: /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Successfully updated port: 5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquired lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-changed-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Refreshing instance network info cache due to event network-changed-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] Acquiring lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Updating instance_info_cache with network_info: [{"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Releasing lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Instance network_info: |[{"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] Acquired lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Refreshing network info cache for port 5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Start _get_guest_xml network_info=[{"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:31:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850921392',display_name='tempest-VolumesAdminNegativeTest-server-1850921392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850921392',id=12,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-nfka30h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:17Z,user_data=None,user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=c4096501-058e-4353-aad7-4ee70fdd18ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'pci_devices' on Instance uuid c4096501-058e-4353-aad7-4ee70fdd18ec {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] End _get_guest_xml xml= Nov 30 06:31:18 user nova-compute[75021]: c4096501-058e-4353-aad7-4ee70fdd18ec Nov 30 06:31:18 user nova-compute[75021]: instance-0000000c Nov 30 06:31:18 user nova-compute[75021]: 524288 Nov 30 06:31:18 user nova-compute[75021]: 1 Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-server-1850921392 Nov 30 06:31:18 user nova-compute[75021]: 2023-11-30 06:31:18 Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: 512 Nov 30 06:31:18 user nova-compute[75021]: 1 Nov 30 06:31:18 user nova-compute[75021]: 0 Nov 30 06:31:18 user nova-compute[75021]: 0 Nov 30 06:31:18 user nova-compute[75021]: 1 Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-197033440-project-member Nov 30 06:31:18 user nova-compute[75021]: tempest-VolumesAdminNegativeTest-197033440 Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: OpenStack Foundation Nov 30 06:31:18 user nova-compute[75021]: OpenStack Nova Nov 30 06:31:18 user nova-compute[75021]: 0.0.0 Nov 30 06:31:18 user nova-compute[75021]: c4096501-058e-4353-aad7-4ee70fdd18ec Nov 30 06:31:18 user nova-compute[75021]: c4096501-058e-4353-aad7-4ee70fdd18ec Nov 30 06:31:18 user nova-compute[75021]: Virtual Machine Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: hvm Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nehalem Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: /dev/urandom Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: Nov 30 06:31:18 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850921392',display_name='tempest-VolumesAdminNegativeTest-server-1850921392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850921392',id=12,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-nfka30h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:17Z,user_data=None,user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=c4096501-058e-4353-aad7-4ee70fdd18ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG os_vif [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82c68bb0-cf63-506d-82bf-27e81f9a8206', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4135b7-51, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e4135b7-51, col_values=(('qos', UUID('2a2d1e34-963e-4d1a-b90e-8893871a79e1')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e4135b7-51, col_values=(('external_ids', {'iface-id': '5e4135b7-5100-4e1e-bbf5-8933f8f5a3de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:b3:d7', 'vm-uuid': 'c4096501-058e-4353-aad7-4ee70fdd18ec'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:18 user nova-compute[75021]: INFO os_vif [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] No VIF found with MAC fa:16:3e:c4:b3:d7, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Updated VIF entry in instance network info cache for port 5e4135b7-5100-4e1e-bbf5-8933f8f5a3de. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Updating instance_info_cache with network_info: [{"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13707278-8990-4d48-8ec1-d0bf4760c76c req-5faa8282-8df9-49a5-a819-557229bbd321 service nova] Releasing lock "refresh_cache-c4096501-058e-4353-aad7-4ee70fdd18ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] No waiting events found dispatching network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:20 user nova-compute[75021]: WARNING nova.compute.manager [req-c1a920ed-8357-4488-bf49-ec76c8ef208b req-bdaccfc6-c538-4f04-b229-a5ff85e760e1 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received unexpected event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de for instance with vm_state building and task_state spawning. Nov 30 06:31:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:31:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Instance spawned successfully. Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:22 user nova-compute[75021]: INFO nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Took 5.07 seconds to spawn the instance on the hypervisor. Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:31:22 user nova-compute[75021]: INFO nova.compute.manager [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Took 5.82 seconds to build instance. Nov 30 06:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f059e442-afad-4100-9783-ae15622bbade tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 5.911s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] No waiting events found dispatching network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:22 user nova-compute[75021]: WARNING nova.compute.manager [req-ea550a8a-8d9a-4d5c-ad44-837b5258b086 req-1225ac8a-a3ac-4168-b2d6-f9f645acb0d8 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received unexpected event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de for instance with vm_state building and task_state spawning. Nov 30 06:31:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Received event network-changed-e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Refreshing instance network info cache due to event network-changed-e916b942-03d1-42b6-b8aa-a092e4419af1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] Acquiring lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] Acquired lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Refreshing network info cache for port e916b942-03d1-42b6-b8aa-a092e4419af1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG nova.network.neutron [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updated VIF entry in instance network info cache for port e916b942-03d1-42b6-b8aa-a092e4419af1. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG nova.network.neutron [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updating instance_info_cache with network_info: [{"id": "e916b942-03d1-42b6-b8aa-a092e4419af1", "address": "fa:16:3e:f5:5c:9a", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape916b942-03", "ovs_interfaceid": "e916b942-03d1-42b6-b8aa-a092e4419af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bca59317-955f-45f3-afc5-0fecda3e44a6 req-88556056-87a6-4de8-b1c8-71e806224a5c service nova] Releasing lock "refresh_cache-b23fb096-817f-4e68-a725-91a7492c5f48" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG nova.objects.instance [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'flavor' on Instance uuid b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.050s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:28 user nova-compute[75021]: INFO nova.compute.manager [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Attaching volume 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 to /dev/vdb Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.utils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b47e1a-b5ea-4bad-a0b0-6b75b77e704d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfd2320-e211-4917-8963-b77e13dce6cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656c8f3-57fe-4efb-995b-3171f392f00a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd898df2-a8be-4a76-8ffc-78d64ddd21a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:28 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:31:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd11d5-768b-4188-ba77-74aa892bbb7b]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG os_brick.utils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:28 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Updating existing volume attachment record: 2beb7004-47fa-4060-830f-ddc2e3506eda {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:29 user nova-compute[75021]: INFO nova.compute.manager [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Terminating instance Nov 30 06:31:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-unplugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] No waiting events found dispatching network-vif-unplugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-a55fb53d-51ee-4d4d-a707-a82c2cc30046 req-f19acc20-30b9-4537-aff9-6316134621df service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-unplugged-1896fcd5-144b-4086-bed5-f69ce04f72eb for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Instance destroyed successfully. Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lazy-loading 'resources' on Instance uuid 3c804836-9890-489d-a0bf-69db4121ea46 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-186370772',display_name='tempest-VolumesAssistedSnapshotsTest-server-186370772',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-186370772',id=7,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF2w6np4hIT+KoW6W8BOLz6Ez69YNIAIuW4Gxg6Pm0DCrzQ2A+/vd3GARqApY109P8N2Zb4vgrJ7A/MKt/Fau/en7A+yRTgqIJ3O88d7DRTpkiL+kWrNkH5ZnA9MgdUxg==',key_name='tempest-keypair-1539196602',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='fd4f2d5e25154b3b86bd047cc784bbe3',ramdisk_id='',reservation_id='r-avde5kri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1792907322',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1792907322-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d5c909cac904290b8ed4c6d8d2b8c12',uuid=3c804836-9890-489d-a0bf-69db4121ea46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converting VIF {"id": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "address": "fa:16:3e:ae:5b:00", "network": {"id": "20b4445f-6496-438c-b704-9d94f1868d29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1911302952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd4f2d5e25154b3b86bd047cc784bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1896fcd5-14", "ovs_interfaceid": "1896fcd5-144b-4086-bed5-f69ce04f72eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG os_vif [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1896fcd5-14, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e40ba707-f0d5-4ad6-ad47-4bebe99e150d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:30 user nova-compute[75021]: INFO os_vif [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=1896fcd5-144b-4086-bed5-f69ce04f72eb,network=Network(20b4445f-6496-438c-b704-9d94f1868d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1896fcd5-14') Nov 30 06:31:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Deleting instance files /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46_del Nov 30 06:31:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Deletion of /opt/stack/data/nova/instances/3c804836-9890-489d-a0bf-69db4121ea46_del complete Nov 30 06:31:30 user nova-compute[75021]: INFO nova.compute.manager [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Took 1.00 seconds to destroy the instance on the hypervisor. Nov 30 06:31:30 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:31:30 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:31 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Took 0.95 seconds to deallocate network for instance. Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-ea6264ac-9e8a-444b-ae44-b7bea7b02262 req-792e8ba0-7373-4b9e-804d-db901da83d03 service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-deleted-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:31 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Deleted allocations for instance 3c804836-9890-489d-a0bf-69db4121ea46 Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] Acquiring lock "3c804836-9890-489d-a0bf-69db4121ea46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] Lock "3c804836-9890-489d-a0bf-69db4121ea46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] No waiting events found dispatching network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:31 user nova-compute[75021]: WARNING nova.compute.manager [req-1f21d6e2-9408-4fe4-a17c-0870d4c1d53a req-91942932-18a0-4a7b-a8da-2ff9197eb33a service nova] [instance: 3c804836-9890-489d-a0bf-69db4121ea46] Received unexpected event network-vif-plugged-1896fcd5-144b-4086-bed5-f69ce04f72eb for instance with vm_state deleted and task_state None. Nov 30 06:31:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aeb943c8-bcd4-45f5-bad7-8355396a49ea tempest-VolumesAssistedSnapshotsTest-1792907322 tempest-VolumesAssistedSnapshotsTest-1792907322-project-member] Lock "3c804836-9890-489d-a0bf-69db4121ea46" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 2.540s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjiWGZRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:37 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:37 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:37 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bcc8d8-28e8-4188-98ea-854c9cbf3839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:31:37 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f587c-4c5a-4ac4-96f9-db9a121f01ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633] added Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a44dcc-ebbd-42a1-bc60-cce9f578c9b7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054132d-ba5d-41d6-82f8-d931a9d0be4b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjiWGZRL {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjiWGZRL" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[08466e74-8793-41eb-abb6-fc994aa49243]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjiWGZRL'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[149d39cb-1339-402b-b8a2-8d98812a5a45]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[78efc10e-57e4-438d-9756-f7eb4828139f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d0741-9c6d-4dfd-8712-d2477b586c71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] Nov 30 06:31:37 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] successful. Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b9fd62-2f0d-4423-a2d8-612f9a744881]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[429be559-d394-4742-8da2-3f12c5353572]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:37 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.039s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c5b07-19e8-4025-bb0e-f7ad4da8591d]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:31:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjiWGZRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:31:38 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:38 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23437623236626164', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623236626164', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:31:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'flavor' on Instance uuid b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] attach device xml: Nov 30 06:31:38 user nova-compute[75021]: Nov 30 06:31:38 user nova-compute[75021]: Nov 30 06:31:38 user nova-compute[75021]: Nov 30 06:31:38 user nova-compute[75021]: 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:31:38 user nova-compute[75021]: Nov 30 06:31:38 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:31:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No VIF found with MAC fa:16:3e:f5:5c:9a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-15f40623-8bbe-4fe8-957c-b41cd7309449 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 11.358s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:42 user nova-compute[75021]: INFO nova.compute.manager [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Detaching volume 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:31:42 user nova-compute[75021]: INFO nova.virt.block_device [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Attempting to driver detach volume 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 from mountpoint /dev/vdb Nov 30 06:31:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Attempting to detach device vdb from instance b23fb096-817f-4e68-a725-91a7492c5f48 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:31:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] detach device xml: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:31:42 user nova-compute[75021]:
Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:31:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Successfully detached device vdb from instance b23fb096-817f-4e68-a725-91a7492c5f48 from the persistent domain config. Nov 30 06:31:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b23fb096-817f-4e68-a725-91a7492c5f48 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:31:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] detach device xml: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: 5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:31:42 user nova-compute[75021]:
Nov 30 06:31:42 user nova-compute[75021]: Nov 30 06:31:42 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:31:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:31:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:31:44 user nova-compute[75021]: INFO nova.compute.claims [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Claim successful on node user Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:31:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:31:44 user nova-compute[75021]: INFO nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Booting with volume 4fb9cd9a-130e-4c68-bd98-49639fcdcd55 at /dev/vda Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc8c87-0e60-449d-a211-8cc0e1924953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.policy [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b6065dafe28436e916d0174d8f54cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe63819ba3243f9ab823325a0e65728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc64a83-d54a-4e08-a43d-6dc842e81f88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3ff9a-9252-421b-a6c3-e8d340fa36f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[806855f2-0410-4d60-9811-6ba6665b6e08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:44 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:31:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29cbf8-5029-4ea0-b12d-1f76aa47e42e]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:44 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating existing volume attachment record: a01ebd0d-ff2b-4d41-bd0b-ba4adc16459f {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully created port: 73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'flavor' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.058s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:45 user nova-compute[75021]: INFO nova.compute.manager [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Attaching volume f2b81199-b73a-4692-b455-3ea73065803c to /dev/vdb Nov 30 06:31:45 user nova-compute[75021]: DEBUG os_brick.utils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759a85c-b749-4d24-b876-617fb96a0a8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85cf9b3-890d-4da4-84f7-671bb67bf3d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6403c25-19fc-4f38-9f3f-3697ee247a4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e0092c-6483-4edb-ba1d-4718e072e1c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:31:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:46 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:31:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[007429a3-b82f-4f67-ad8a-e407ff151058]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG os_brick.utils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating existing volume attachment record: 21a1ad62-caae-4619-ae30-5ece07d0d8d2 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully created port: 6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully created port: 81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully created port: 533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully created port: a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: 73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-73a71cb4-81fa-4228-a175-1452b5f26c9f. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-df824b9d-6005-4296-b24b-34fb741b7ab1 req-667d962e-9c0b-4ed5-9560-6dc8b5dfbe47 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:31:49 user nova-compute[75021]: INFO nova.compute.claims [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Claim successful on node user Nov 30 06:31:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: 37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:31:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.policy [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0200b58bd1534bc28872adc5cf426ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de15912e470d4bc0b9ab9f3fb6142c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:31:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Creating image(s) Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-d0cf9163-64a6-4731-ae86-1b64ec070c49. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: 6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk 1073741824" returned: 0 in 0.060s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.262s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-37339b54-cba3-4b15-afef-5519ca06d8e7. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Successfully created port: c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Cannot resize image /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: 81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e812b4f2-6458-46bd-a9d2-be55f4f6360b req-e609b9a8-3cb7-462f-86c0-bb0d39db86a8 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Successfully updated port: c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquired lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-changed-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Refreshing instance network info cache due to event network-changed-c85c214d-5540-4ee9-98d8-e6c216dab155. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] Acquiring lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: 533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updating instance_info_cache with network_info: [{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Releasing lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance network_info: |[{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] Acquired lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Refreshing network info cache for port c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Start _get_guest_xml network_info=[{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:31:52 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:52 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-247650384',display_name='tempest-tempest.common.compute-instance-247650384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-247650384',id=14,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFChRM0w/i91cbkgMIMcthhn+p2CU1fJz4Xb8hxlpy4nFA3oX5zbks8t7f/tS7KHuaxAgBYPifiwvu7dlOgqRlGddtoQoP2dwkBJ93a9ul51qiUUQ8M/T6VYXGAm+mXbg==',key_name='tempest-keypair-1106661472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-ea0wi5sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=c811878a-676f-43ed-ba7f-2b765a3c51bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lazy-loading 'pci_devices' on Instance uuid c811878a-676f-43ed-ba7f-2b765a3c51bb {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] End _get_guest_xml xml= Nov 30 06:31:52 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:31:52 user nova-compute[75021]: instance-0000000e Nov 30 06:31:52 user nova-compute[75021]: 524288 Nov 30 06:31:52 user nova-compute[75021]: 1 Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: tempest-tempest.common.compute-instance-247650384 Nov 30 06:31:52 user nova-compute[75021]: 2023-11-30 06:31:52 Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: 512 Nov 30 06:31:52 user nova-compute[75021]: 1 Nov 30 06:31:52 user nova-compute[75021]: 0 Nov 30 06:31:52 user nova-compute[75021]: 0 Nov 30 06:31:52 user nova-compute[75021]: 1 Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321-project-member Nov 30 06:31:52 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321 Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: OpenStack Foundation Nov 30 06:31:52 user nova-compute[75021]: OpenStack Nova Nov 30 06:31:52 user nova-compute[75021]: 0.0.0 Nov 30 06:31:52 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:31:52 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:31:52 user nova-compute[75021]: Virtual Machine Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: hvm Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nehalem Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: /dev/urandom Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: Nov 30 06:31:52 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-247650384',display_name='tempest-tempest.common.compute-instance-247650384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-247650384',id=14,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFChRM0w/i91cbkgMIMcthhn+p2CU1fJz4Xb8hxlpy4nFA3oX5zbks8t7f/tS7KHuaxAgBYPifiwvu7dlOgqRlGddtoQoP2dwkBJ93a9ul51qiUUQ8M/T6VYXGAm+mXbg==',key_name='tempest-keypair-1106661472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-ea0wi5sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=c811878a-676f-43ed-ba7f-2b765a3c51bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG os_vif [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d296419-3c9b-504c-9e42-b17711439bea', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-6d4c56ec-9308-4d24-8af9-48ebef910ba1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc85c214d-55, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc85c214d-55, col_values=(('qos', UUID('c78a33b3-f9f2-4281-9c68-5f61e280c724')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc85c214d-55, col_values=(('external_ids', {'iface-id': 'c85c214d-5540-4ee9-98d8-e6c216dab155', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:61:94', 'vm-uuid': 'c811878a-676f-43ed-ba7f-2b765a3c51bb'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Successfully updated port: a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:52 user nova-compute[75021]: INFO os_vif [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No VIF found with MAC fa:16:3e:5d:61:94, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updated VIF entry in instance network info cache for port c85c214d-5540-4ee9-98d8-e6c216dab155. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updating instance_info_cache with network_info: [{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-836fba44-aeeb-4806-a9be-944daa57d70a req-5d9cf91c-dc74-4369-9a9c-2e64fb7e1a70 service nova] Releasing lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-81667051-ce58-4c05-963a-32393522c451. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-533363e2-40a3-4260-99d8-05505dd7a43a. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ab192d72-bc8d-43fc-b6fe-ed481793b762 req-672a8f12-df4e-4be0-89a8-4cfd7064fc18 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:31:53 user nova-compute[75021]: INFO nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Booting with volume 029093ce-51ef-4eee-87b0-fd37109774a3 at /dev/vdb Nov 30 06:31:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa46cf-f83c-44cc-a2fe-6a0743e9a8ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb57d6-b7d2-423d-89d8-c663851a3c38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[600a8fbc-8b45-44e8-931e-b51d0acbf8b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0592fc78-9e1b-42c5-8b2d-1d1518be3712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:31:54 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2081bc52-e54e-4173-8ff6-6f6152fdb2f0]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== get_connector_properties: return (226ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating existing volume attachment record: 589bd34b-8708-4947-b7cb-260e19a683bb {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:54 user nova-compute[75021]: WARNING nova.compute.manager [req-2c3f7a40-5d76-4106-8c06-efcaad70e926 req-16f8561a-acc3-4915-ac82-9456e1df2363 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state building and task_state spawning. Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-a83f0afb-ef7e-49dc-8b62-88c9f8c30889. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:31:56 user nova-compute[75021]: WARNING nova.compute.manager [req-35e38516-7dca-4e2c-b555-5aeb48aa2612 req-531e0287-31fb-4d66-a302-b5c5e85a1844 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state building and task_state spawning. Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:56 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:56 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:56 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance spawned successfully. Nov 30 06:31:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=25.533309936523438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2b431-5f45-4b5f-8b6f-c51aba7c8b87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:31:56 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e934caa-1f49-4a4d-90af-ca293b7952c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added Nov 30 06:31:56 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1951a-f1c6-4f2e-a545-97a2cea36f36]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a35a6-f5d1-4610-ac2f-b00101ed5192]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15f895c-36ac-41f1-8c30-83d138037534]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRiMurZE'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: INFO nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Took 6.52 seconds to spawn the instance on the hypervisor. Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4bc9f1-0d96-4ce4-b8f4-3c2d211d0c14]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17609c1f-69f4-4e8f-b667-ed599eff960e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance f7b6383f-a916-400f-8424-54fbbffec7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c4096501-058e-4353-aad7-4ee70fdd18ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 762ed361-1cae-4274-a9af-81f4533ca75a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c811878a-676f-43ed-ba7f-2b765a3c51bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:31:57 user nova-compute[75021]: INFO nova.compute.manager [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Took 7.42 seconds to build instance. Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74804ece-f085-42c7-a209-29d0096da312]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] Nov 30 06:31:57 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful. Nov 30 06:31:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586b984-0a2b-4e10-8fd7-2af462a33856]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7400a56f-7d3b-4f88-a3f4-b19f18740a78 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 7.539s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb02e46-a8a3-4dc7-a5f8-03649db11935]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:57 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2e493-9885-4fcf-a0d9-a687434e902d]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquired lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'info_cache' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Updating instance_info_cache with network_info: [{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Releasing lock "refresh_cache-9f0fa9f8-75a4-48ba-8096-49e7665a0511" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance destroyed successfully. Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'resources' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1357487691',display_name='tempest-AttachVolumeTestJSON-server-1357487691',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1357487691',id=1,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMznkj7B92rG9oZ1PxSeZBMOvqjGEzLI1aFFJ1QuTq1ou2nXdQqcjWpOGFxFpRoOM7A4awCh8x5z3xerOZ6um74arCyWudJs21u/uURimEpv500BhrT+nmuXGmWzRny35Q==',key_name='tempest-keypair-1401620803',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='b91080509e144b6ca051cdde9dffdffc',ramdisk_id='',reservation_id='r-8k2g0ev2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1859687396',owner_user_name='tempest-AttachVolumeTestJSON-1859687396-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='728a965ff86d42a0b37efb0b6e39bded',uuid=9f0fa9f8-75a4-48ba-8096-49e7665a0511,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converting VIF {"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'flavor' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb1058b-c8, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=363940cf-ff78-4158-8864-acf65d9edf7f) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:31:58 user nova-compute[75021]: INFO os_vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] attach device xml: Nov 30 06:31:58 user nova-compute[75021]: Nov 30 06:31:58 user nova-compute[75021]: Nov 30 06:31:58 user nova-compute[75021]: Nov 30 06:31:58 user nova-compute[75021]: f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:31:58 user nova-compute[75021]: Nov 30 06:31:58 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[be399fb7-5d5d-49f9-99a5-f7cd98b2b928]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:31:58 user nova-compute[75021]: No targets found. Nov 30 06:31:58 user nova-compute[75021]: iSNS: Nov 30 06:31:58 user nova-compute[75021]: No targets found. Nov 30 06:31:58 user nova-compute[75021]: STATIC: Nov 30 06:31:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:31:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:58 user nova-compute[75021]: Iface Name: default Nov 30 06:31:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:31:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:58 user nova-compute[75021]: Iface Name: default Nov 30 06:31:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:31:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:58 user nova-compute[75021]: Iface Name: default Nov 30 06:31:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:31:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:31:58 user nova-compute[75021]: Iface Name: default Nov 30 06:31:58 user nova-compute[75021]: FIRMWARE: Nov 30 06:31:58 user nova-compute[75021]: No targets found. Nov 30 06:31:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:31:58 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:31:58 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7c964-f92f-45f8-b6ee-8e4c46b115a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[753130c9-2ba9-4ea5-b498-27b3f821cded]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:58 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Resulting device map defaultdict(. at 0x7f000036dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9964bc-7719-4f1a-9f72-36dd21e02ed6]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14daf5a1-5763-460d-ac2c-c4bfbead97a1]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d6b498-1f58-455a-8491-235fd548ec22]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecbd58e-8ee8-4e83-9205-c83c67ee66a5]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7163712-5201-4280-bcb6-571685d4c246]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6f9086-72e7-40be-be06-64d98023a5d4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] Nov 30 06:31:58 user nova-compute[75021]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful. Nov 30 06:31:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8809d34-b155-456e-942a-de1bac0994b5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] <== disconnect_volume: return (406ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance network_info: |[{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.neutron [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Start _get_guest_xml network_info=[{"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9f0fa9f8-75a4-48ba-8096-49e7665a0511', 'attached_at': '', 'detached_at': '', 'volume_id': '482c363d-cfed-4540-bfe6-65d877a34c40', 'serial': '482c363d-cfed-4540-bfe6-65d877a34c40'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1c111d2f-2835-4d8e-a890-85aa3698ca2e', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:31:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No VIF found with MAC fa:16:3e:82:c8:d0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:31:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:31:58 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ccd86d-4b58-46a9-92ae-42084a820e4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:31:58 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a73cb31-2def-41a8-b88b-1da68e8cbf89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40] added Nov 30 06:31:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8d214-17ea-4181-a01d-0abded2bd37b]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14219858-4069-4ef0-b4a9-efe57f789cb7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOGVuvRe {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-abe7f4ee-f78e-4c0d-8fa8-eaa7a7063921 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 13.237s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOGVuvRe" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0907c-521b-4d76-8ceb-e7c704899e6a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOGVuvRe'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb51a4f-003b-49ff-ac47-8fffd63488c0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b27b62-1a32-4220-9e4a-d1b966aa5836]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:59 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:59 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0531f-ac1a-4ba0-920c-9a2d7bfa5fe3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] Nov 30 06:31:59 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful. Nov 30 06:31:59 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7920177-bd2b-42be-96cb-e8830d6cf38f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df682118-889f-4568-9fff-e6b35628575b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:31:59 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:31:59 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3cf9e-078f-43b0-9aa4-484412373368]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG nova.network.neutron [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updated VIF entry in instance network info cache for port a83f0afb-ef7e-49dc-8b62-88c9f8c30889. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG nova.network.neutron [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d98e55c-4e40-4ec7-9075-42b52187deec req-21ab508f-4016-4604-82af-ac96c7db30bc service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updating instance_info_cache with network_info: [{"id": "41865556-22cf-4324-9f33-7fe485aefed0", "address": "fa:16:3e:ba:5c:37", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41865556-22", "ovs_interfaceid": "41865556-22cf-4324-9f33-7fe485aefed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-63ed94e2-f3c4-48ca-8c90-29ddf619e309" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 63ed94e2-f3c4-48ca-8c90-29ddf619e309] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:31:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26239316664386539', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239316664386539', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1357487691',display_name='tempest-AttachVolumeTestJSON-server-1357487691',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1357487691',id=1,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMznkj7B92rG9oZ1PxSeZBMOvqjGEzLI1aFFJ1QuTq1ou2nXdQqcjWpOGFxFpRoOM7A4awCh8x5z3xerOZ6um74arCyWudJs21u/uURimEpv500BhrT+nmuXGmWzRny35Q==',key_name='tempest-keypair-1401620803',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='b91080509e144b6ca051cdde9dffdffc',ramdisk_id='',reservation_id='r-8k2g0ev2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1859687396',owner_user_name='tempest-AttachVolumeTestJSON-1859687396-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='728a965ff86d42a0b37efb0b6e39bded',uuid=9f0fa9f8-75a4-48ba-8096-49e7665a0511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converting VIF {"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] End _get_guest_xml xml= Nov 30 06:32:00 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:32:00 user nova-compute[75021]: instance-00000001 Nov 30 06:32:00 user nova-compute[75021]: 524288 Nov 30 06:32:00 user nova-compute[75021]: 1 Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: tempest-AttachVolumeTestJSON-server-1357487691 Nov 30 06:32:00 user nova-compute[75021]: 2023-11-30 06:31:58 Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: 512 Nov 30 06:32:00 user nova-compute[75021]: 1 Nov 30 06:32:00 user nova-compute[75021]: 0 Nov 30 06:32:00 user nova-compute[75021]: 0 Nov 30 06:32:00 user nova-compute[75021]: 1 Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: tempest-AttachVolumeTestJSON-1859687396-project-member Nov 30 06:32:00 user nova-compute[75021]: tempest-AttachVolumeTestJSON-1859687396 Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: OpenStack Foundation Nov 30 06:32:00 user nova-compute[75021]: OpenStack Nova Nov 30 06:32:00 user nova-compute[75021]: 0.0.0 Nov 30 06:32:00 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:32:00 user nova-compute[75021]: 9f0fa9f8-75a4-48ba-8096-49e7665a0511 Nov 30 06:32:00 user nova-compute[75021]: Virtual Machine Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: hvm Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nehalem Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: 482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: /dev/urandom Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: Nov 30 06:32:00 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Stashing vm_state: active {{(pid=75021) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:32:01 user nova-compute[75021]: INFO nova.compute.claims [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Claim successful on node user Nov 30 06:32:01 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating resource usage from migration 31a5e434-0aed-46ca-9e82-b392ca96821d Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Cannot resize image /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'migration_context' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.objects.base [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Object Instance<9f0fa9f8-75a4-48ba-8096-49e7665a0511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1357487691',display_name='tempest-AttachVolumeTestJSON-server-1357487691',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1357487691',id=1,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMznkj7B92rG9oZ1PxSeZBMOvqjGEzLI1aFFJ1QuTq1ou2nXdQqcjWpOGFxFpRoOM7A4awCh8x5z3xerOZ6um74arCyWudJs21u/uURimEpv500BhrT+nmuXGmWzRny35Q==',key_name='tempest-keypair-1401620803',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=,power_state=4,progress=0,project_id='b91080509e144b6ca051cdde9dffdffc',ramdisk_id='',reservation_id='r-8k2g0ev2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1859687396',owner_user_name='tempest-AttachVolumeTestJSON-1859687396-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='728a965ff86d42a0b37efb0b6e39bded',uuid=9f0fa9f8-75a4-48ba-8096-49e7665a0511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converting VIF {"id": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "address": "fa:16:3e:9e:fb:b2", "network": {"id": "a1671d81-2b41-44e5-b447-194c6ad8da5f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1355635813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b91080509e144b6ca051cdde9dffdffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb1058b-c8", "ovs_interfaceid": "1bb1058b-c894-4e0a-90f0-e55b835b8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG os_vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59733c3d-6bd3-59a1-ac76-5713c25b9fce', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb1058b-c8, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb1058b-c8, col_values=(('qos', UUID('52ef0c7d-896e-45e5-8547-2c71227dd226')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb1058b-c8, col_values=(('external_ids', {'iface-id': '1bb1058b-c894-4e0a-90f0-e55b835b8679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:fb:b2', 'vm-uuid': '9f0fa9f8-75a4-48ba-8096-49e7665a0511'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:01 user nova-compute[75021]: INFO os_vif [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=1bb1058b-c894-4e0a-90f0-e55b835b8679,network=Network(a1671d81-2b41-44e5-b447-194c6ad8da5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb1058b-c8') Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.548s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:01 user nova-compute[75021]: INFO nova.compute.manager [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Migrating Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:01 user nova-compute[75021]: INFO nova.compute.rpcapi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG nova.network.neutron [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Starting migrate_disk_and_power_off {{(pid=75021) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:03 user nova-compute[75021]: WARNING nova.compute.manager [req-8b5cdb35-1e34-4ef1-86d2-73882d3ebc24 req-d4e615d1-219c-4141-8da6-b545bace1e01 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state resize_migrating. Nov 30 06:32:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b23fb096-817f-4e68-a725-91a7492c5f48 is timed out. Nov 30 06:32:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Successfully detached device vdb from instance b23fb096-817f-4e68-a725-91a7492c5f48 from the live domain config. Nov 30 06:32:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjiWGZRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:03 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0226abba-affe-4f74-928b-ae41426c43aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:32:03 user nova-compute[75021]: No targets found. Nov 30 06:32:03 user nova-compute[75021]: iSNS: Nov 30 06:32:03 user nova-compute[75021]: No targets found. Nov 30 06:32:03 user nova-compute[75021]: STATIC: Nov 30 06:32:03 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 Nov 30 06:32:03 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:03 user nova-compute[75021]: Iface Name: default Nov 30 06:32:03 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:32:03 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:03 user nova-compute[75021]: Iface Name: default Nov 30 06:32:03 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:32:03 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:03 user nova-compute[75021]: Iface Name: default Nov 30 06:32:03 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:32:03 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:03 user nova-compute[75021]: Iface Name: default Nov 30 06:32:03 user nova-compute[75021]: FIRMWARE: Nov 30 06:32:03 user nova-compute[75021]: No targets found. Nov 30 06:32:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:32:03 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:32:03 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de2d55-8d2b-4d5a-b9a2-b7c3bb1fe40c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18975b1-ba97-4bfa-9a81-373713b79a10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Resulting device map defaultdict(. at 0x7f00181f4c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[84261f21-b50a-4aed-af8a-23a124502b33]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e3907-d83a-4658-8866-7ed68c717c2d]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d6806-557b-4d22-b054-b37504ebb56d]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.091s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ad57f-ebbc-4fe8-922d-f3561b18cd2e]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3de21-b954-4bed-bb2f-c85bc2bdca95]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19adc1-d440-45fb-a4dd-d74d380514a6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] Nov 30 06:32:03 user nova-compute[75021]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633, portal: 172.16.0.220,3260] successful. Nov 30 06:32:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d1202de-3b92-4d5c-8fcf-84a12f3ad633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.202s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[18595f04-29fd-405a-9eac-0a3b4fed51f7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.590s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] <== disconnect_volume: return (591ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:32:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance destroyed successfully. Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6588b659-35, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30e13c62-ea1c-4798-98c6-ef025e082232) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: INFO os_vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dda91a-027f-4d33-8d82-101fe3f2f83d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:32:04 user nova-compute[75021]: No targets found. Nov 30 06:32:04 user nova-compute[75021]: iSNS: Nov 30 06:32:04 user nova-compute[75021]: No targets found. Nov 30 06:32:04 user nova-compute[75021]: STATIC: Nov 30 06:32:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:32:04 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:04 user nova-compute[75021]: Iface Name: default Nov 30 06:32:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:32:04 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:04 user nova-compute[75021]: Iface Name: default Nov 30 06:32:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:32:04 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:32:04 user nova-compute[75021]: Iface Name: default Nov 30 06:32:04 user nova-compute[75021]: FIRMWARE: Nov 30 06:32:04 user nova-compute[75021]: No targets found. Nov 30 06:32:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:32:04 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:32:04 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c235f2-e292-4c4d-9d12-82fd68ad0770]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cca235-77cd-487f-834d-f6d6bd46258b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:04 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:04 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:04 user nova-compute[75021]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:04 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Resulting device map defaultdict(. at 0x7f00181f60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e513320-722e-44f0-be92-647bb3c27e9a]: (4, ('path checker states:\nup 3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: INFO nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Booting with volume b57db425-9b9a-4f1a-9ff4-53a8563271d3 at /dev/vdc Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae090c-c024-468a-99e4-c8f926bb821c]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb142df-128c-4c38-aa91-3652778618a9]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c84dd-2068-487a-9daf-c9c2f7cc95a7]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92192ae-dcb4-4cd4-ae0b-1caed1e602f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3bfcb4-4918-497d-9375-2fcfa32a5b25]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5258c9-ed8c-4382-ab32-3215bace62db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ba83ac-e03e-418f-993e-214a3a5f3e2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a63e9f-10f0-45a8-85c7-a55d3edad29e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e4f8c-80dd-4244-b685-c16eaee3332e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] Nov 30 06:32:04 user nova-compute[75021]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful. Nov 30 06:32:04 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:04 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee00e96-912b-4be5-bdb6-c4343eefa89a]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.utils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating existing volume attachment record: c03069a9-882a-4bd8-a6c1-fb2c92deb2f6 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e48fe-f3d5-45df-8791-c665cb5e308f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== disconnect_volume: return (423ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'flavor' on Instance uuid b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bd0f05c8-f498-4468-b926-2d1fb7deb307 tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.368s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638_resize/disk /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:05 user nova-compute[75021]: WARNING nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state resize_migrating. Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:05 user nova-compute[75021]: WARNING nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state stopped and task_state powering-on. Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:05 user nova-compute[75021]: WARNING nova.compute.manager [req-ece8c51b-9286-4981-93be-5337bebbdc5c req-0492a2c5-c513-4866-9b07-23ba3c7e3fa5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state stopped and task_state powering-on. Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "cp -r /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638_resize/disk /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk" returned: 0 in 0.653s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638_resize/disk.info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk.info {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "cp -r /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638_resize/disk.info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk.info" returned: 0 in 0.033s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:32:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance rebooted successfully. Nov 30 06:32:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-db9fcd5b-40cf-424a-ae37-1e79ac9d66c9 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:32:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Port 6588b659-358d-40ed-9176-a98946d4cc7c binding to destination host user is already ACTIVE {{(pid=75021) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:32:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.utils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ecd2c-c520-4e5d-8cba-89cf7563c573]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2466ef-270c-41ac-a5e8-d68a6ee91a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2551ec-59d3-40ff-902a-5e535ff79c70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6bce9-7c1c-4015-86e6-d53c72aff4ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:08 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:32:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a759a7e-4716-4a2f-b220-8f0a68c67463]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:32:08 user nova-compute[75021]: DEBUG os_brick.utils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:32:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Creating image(s) Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Ensure instance console log exists: /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Start _get_guest_xml network_info=[{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKgEYmrH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '762ed361-1cae-4274-a9af-81f4533ca75a', 'attached_at': '', 'detached_at': '', 'volume_id': '4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 'serial': '4fb9cd9a-130e-4c68-bd98-49639fcdcd55'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a01ebd0d-ff2b-4d41-bd0b-ba4adc16459f', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANriqVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '762ed361-1cae-4274-a9af-81f4533ca75a', 'attached_at': '', 'detached_at': '', 'volume_id': '029093ce-51ef-4eee-87b0-fd37109774a3', 'serial': '029093ce-51ef-4eee-87b0-fd37109774a3'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '589bd34b-8708-4947-b7cb-260e19a683bb', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'samXuzWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '762ed361-1cae-4274-a9af-81f4533ca75a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b57db425-9b9a-4f1a-9ff4-53a8563271d3', 'serial': 'b57db425-9b9a-4f1a-9ff4-53a8563271d3'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c03069a9-882a-4bd8-a6c1-fb2c92deb2f6', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:32:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKgEYmrH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:14 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:14 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:14 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2abecd-5728-4d7c-855a-94199ad265bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:32:14 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ef77e-250a-4f1d-b5f7-0aa50361c150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55] added Nov 30 06:32:14 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae5270-92a8-4cd7-8ab1-a117707bdeeb]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8dde6a-47de-447e-86d6-2de8ee1657a2]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKgEYmrH {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKgEYmrH" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9abb94-2801-474d-8445-7ea97f7c3f91]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uKgEYmrH'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[83701a02-d551-4bc4-830c-3e66eea6dbcb]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[374f6482-cd5b-4a3a-bcfb-c3f19a01003c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:14 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:14 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:14 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:14 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb10e3c-0230-46de-bf86-966e9d66ef5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] Nov 30 06:32:15 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] successful. Nov 30 06:32:15 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3c15c-630a-4156-89d4-3ecaf38e4431]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465b463-1345-4e5c-b0ff-150c8a71d0bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:15 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0fd87e-4c1d-43da-a352-f8e9163cf2d9]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKgEYmrH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26566616230643164', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566616230643164', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANriqVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:16 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d11ac-104e-4a17-aacd-434e91bbd34a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:32:16 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf79ca9-03e8-4bbf-9cbd-7aaa1e65585d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3] added Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c174c-9d88-4df4-9c73-c8e400526cb4]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e21b6ad-f2fe-4df1-8706-921cad113f8c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANriqVwm {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANriqVwm" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ce0fb-81db-43ca-bbd7-1a69968368ba]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANriqVwm'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eebc988-9f89-4296-af1d-080e832df1c5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[be082a90-ec43-4b0c-9cc9-f2c1a8154b1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd8b21-fa48-42fb-b5b4-a23bf5a16dd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] Nov 30 06:32:16 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] successful. Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ed29a-627a-46d7-8b31-03494a43efe9]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa261e39-60b2-4773-bcbd-69875d168f10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:16 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f0ab7-ff6b-4574-8c7b-0e3f882b9490]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANriqVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26466336166393832', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466336166393832', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'samXuzWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:17 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccfb26e-4657-49c3-bd0a-eddd169ce97a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:32:17 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24efdaa-6697-433a-b020-76496010bfcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3] added Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c95f6-66bd-4b8c-a622-036992e9b2a8]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a687086-6a68-4180-8e8e-874570ba8c98]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v samXuzWV {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v samXuzWV" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a067e345-506a-499f-9e36-bba05071c40c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'samXuzWV'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[376d4975-e8ca-4544-848e-e475b2d16452]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69e479-121e-46a4-85c9-4b3b2164861c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc105bc-f5f9-434b-bfdb-32a8ee46799f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] Nov 30 06:32:17 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] successful. Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce19d0c-c48d-4345-8d27-62ad5b668c6d]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a8f984-df7b-49bd-aaf7-bf74638c0dae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68191ca-d7ba-4e61-b64a-075ef07bc9cb]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'samXuzWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Starting finish_migration {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}} Nov 30 06:32:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Creating image(s) Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.259s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk. size=21474836480 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk 21474836480 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk 21474836480" returned: 0 in 0.042s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Ensure instance console log exists: /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start _get_guest_xml network_info=[{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8e38220a-0fa9-4c33-a344-c421d3bfb638', 'attached_at': '2023-11-30T06:32:18.000000', 'detached_at': '', 'volume_id': 'f2b81199-b73a-4692-b455-3ea73065803c', 'serial': 'f2b81199-b73a-4692-b455-3ea73065803c'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e256c3ca-52d8-4815-8be0-46a4b1e19757', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:32:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:18 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23262623435393331', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262623435393331', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.263s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:18 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:18 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:32:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f81640-bfca-4d11-adcc-e17b2fd70e42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:32:19 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lazy-loading 'pci_devices' on Instance uuid 762ed361-1cae-4274-a9af-81f4533ca75a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e047ccdc-6499-43b8-bd6c-25437d71b742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] End _get_guest_xml xml= Nov 30 06:32:19 user nova-compute[75021]: 762ed361-1cae-4274-a9af-81f4533ca75a Nov 30 06:32:19 user nova-compute[75021]: instance-0000000d Nov 30 06:32:19 user nova-compute[75021]: 524288 Nov 30 06:32:19 user nova-compute[75021]: 1 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: tempest-device-tagging-server-2140011399 Nov 30 06:32:19 user nova-compute[75021]: 2023-11-30 06:32:14 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: 512 Nov 30 06:32:19 user nova-compute[75021]: 1 Nov 30 06:32:19 user nova-compute[75021]: 0 Nov 30 06:32:19 user nova-compute[75021]: 0 Nov 30 06:32:19 user nova-compute[75021]: 1 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: tempest-TaggedBootDevicesTest-1763169621-project-member Nov 30 06:32:19 user nova-compute[75021]: tempest-TaggedBootDevicesTest-1763169621 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: OpenStack Foundation Nov 30 06:32:19 user nova-compute[75021]: OpenStack Nova Nov 30 06:32:19 user nova-compute[75021]: 0.0.0 Nov 30 06:32:19 user nova-compute[75021]: 762ed361-1cae-4274-a9af-81f4533ca75a Nov 30 06:32:19 user nova-compute[75021]: 762ed361-1cae-4274-a9af-81f4533ca75a Nov 30 06:32:19 user nova-compute[75021]: Virtual Machine Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: hvm Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nehalem Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: 4fb9cd9a-130e-4c68-bd98-49639fcdcd55 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: 029093ce-51ef-4eee-87b0-fd37109774a3 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: b57db425-9b9a-4f1a-9ff4-53a8563271d3 Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: /dev/urandom Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: Nov 30 06:32:19 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[646723cc-d85b-400d-b1af-7285ecac8421]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60656264-3492-5eed-a185-f3bd71f3303f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73a71cb4-81, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73a71cb4-81, col_values=(('qos', UUID('fccf4bdc-5e37-4ae8-9605-5c685e655805')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73a71cb4-81, col_values=(('external_ids', {'iface-id': '73a71cb4-81fa-4228-a175-1452b5f26c9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f5:5f', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c606ce6-f17b-4202-9bfe-d57bae9dd34e]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07d2e24b-5dc7-54ed-b23d-b397bae2dee5', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE" returned: 0 in 0.038s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[19943b5d-bba9-4c46-946c-940e053a1b78]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRiMurZE'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cf9163-64, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0cf9163-64, col_values=(('qos', UUID('8e47d2af-c6de-4e3a-93bc-81236ab6e611')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0cf9163-64, col_values=(('external_ids', {'iface-id': 'd0cf9163-64a6-4731-ae86-1b64ec070c49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:cf:51', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0b364d-c7ba-49f1-88fc-23454641e31d]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc0c48de-8404-5b18-9759-d7da48477691', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b3de1f-e3f1-4f50-acd6-ea1c7b1979fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37339b54-cb, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37339b54-cb, col_values=(('qos', UUID('0fde1f2f-9c97-481f-a13c-b189ce78bded')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37339b54-cb, col_values=(('external_ids', {'iface-id': '37339b54-cba3-4b15-afef-5519ca06d8e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:5c:95', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e1522b2-9386-5312-8960-e0cf4b81eaa5', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d5b222-dead-4475-8ed6-a4c311bd0183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] Nov 30 06:32:19 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful. Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d4c56ec-93, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d4c56ec-93, col_values=(('qos', UUID('8aacb113-a712-4cae-849c-ff9fefb5da4c')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d4c56ec-93, col_values=(('external_ids', {'iface-id': '6d4c56ec-9308-4d24-8af9-48ebef910ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1c:4d', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e15285-e9ce-4390-9fd1-14448b44e85f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f58ae7-d429-4557-a4c3-0d260c7c3f53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:19 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:19 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2c8ce28-910d-5a05-861b-b0da64a6585a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[49955ce0-9b3e-463f-90e4-652952fe4a9e]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81667051-ce, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81667051-ce, col_values=(('qos', UUID('07620d54-2f85-4cf5-aaa3-f4d5bb00df50')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81667051-ce, col_values=(('external_ids', {'iface-id': '81667051-ce58-4c05-963a-32393522c451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:40:ef', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a88a0d82-3d45-5dfb-8edc-2856a3d90dc0', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap533363e2-40, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap533363e2-40, col_values=(('qos', UUID('181b69b3-ae1b-4f85-b694-0b3273cdad33')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap533363e2-40, col_values=(('external_ids', {'iface-id': '533363e2-40a3-4260-99d8-05505dd7a43a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:ee:8f', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe16f46-92d6-5092-ada2-671c3d8384e8', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa83f0afb-ef, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa83f0afb-ef, col_values=(('qos', UUID('f2889447-16e3-4a7d-a501-02278bfa41ec')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa83f0afb-ef, col_values=(('external_ids', {'iface-id': 'a83f0afb-ef7e-49dc-8b62-88c9f8c30889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:99:b9', 'vm-uuid': '762ed361-1cae-4274-a9af-81f4533ca75a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:19 user nova-compute[75021]: INFO os_vif [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] No VIF found with MAC fa:16:3e:e4:f5:5f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:32:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] No VIF found with MAC fa:16:3e:20:40:ef, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:32:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Using config drive Nov 30 06:32:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Creating config drive at /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a/disk.config Nov 30 06:32:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl0hq3mqt {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl0hq3mqt" returned: 0 in 0.070s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== connect_volume: return (1745ms) {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] End _get_guest_xml xml= Nov 30 06:32:20 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:32:20 user nova-compute[75021]: instance-00000003 Nov 30 06:32:20 user nova-compute[75021]: 2097152 Nov 30 06:32:20 user nova-compute[75021]: 1 Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: tempest-ServerActionsTestOtherB-server-814384843 Nov 30 06:32:20 user nova-compute[75021]: 2023-11-30 06:32:18 Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: 2048 Nov 30 06:32:20 user nova-compute[75021]: 20 Nov 30 06:32:20 user nova-compute[75021]: 0 Nov 30 06:32:20 user nova-compute[75021]: 0 Nov 30 06:32:20 user nova-compute[75021]: 1 Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113-project-member Nov 30 06:32:20 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113 Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: OpenStack Foundation Nov 30 06:32:20 user nova-compute[75021]: OpenStack Nova Nov 30 06:32:20 user nova-compute[75021]: 0.0.0 Nov 30 06:32:20 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:32:20 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:32:20 user nova-compute[75021]: Virtual Machine Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: hvm Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nehalem Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: /dev/urandom Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: Nov 30 06:32:20 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-39192172-network", "vif_mac": "fa:16:3e:82:c8:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG os_vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3cf38a-7f55-5208-ac42-9fc77b9d2c74', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6588b659-35, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6588b659-35, col_values=(('qos', UUID('58dac384-596a-4c9c-acb0-815262fcccd3')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6588b659-35, col_values=(('external_ids', {'iface-id': '6588b659-358d-40ed-9176-a98946d4cc7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c8:d0', 'vm-uuid': '8e38220a-0fa9-4c33-a344-c421d3bfb638'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:20 user nova-compute[75021]: INFO os_vif [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] No VIF found with MAC fa:16:3e:82:c8:d0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:32:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:23 user nova-compute[75021]: WARNING nova.compute.manager [req-4779b277-2490-4994-b150-1dc0a0947799 req-370a342e-f71f-4840-8299-5c316a749b24 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f for instance with vm_state building and task_state spawning. Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:24 user nova-compute[75021]: WARNING nova.compute.manager [req-ceabdf55-234b-4b39-8836-26f678d0f6e3 req-8b678b45-1915-4663-a648-b5585fe47c00 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 for instance with vm_state building and task_state spawning. Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:24 user nova-compute[75021]: WARNING nova.compute.manager [req-d440157f-123e-4a98-930a-d867d3143ff9 req-0578f762-a138-4ecb-9c42-dc10e4b2dd74 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 for instance with vm_state building and task_state spawning. Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:25 user nova-compute[75021]: WARNING nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f for instance with vm_state building and task_state spawning. Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:25 user nova-compute[75021]: WARNING nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state resize_finish. Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:25 user nova-compute[75021]: WARNING nova.compute.manager [req-14c8a93f-8e37-4273-bc56-59c011e9d5c1 req-c7fddbab-44bc-47c0-8d7a-d34fefe948a7 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state active and task_state resize_finish. Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:26 user nova-compute[75021]: WARNING nova.compute.manager [req-186e4d46-b46c-4ace-9aa9-a912f2ae49ff req-b618b5a4-1896-461d-88b6-38ab169b7509 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 for instance with vm_state building and task_state spawning. Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:26 user nova-compute[75021]: WARNING nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 for instance with vm_state building and task_state spawning. Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:26 user nova-compute[75021]: WARNING nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 for instance with vm_state building and task_state spawning. Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:26 user nova-compute[75021]: WARNING nova.compute.manager [req-f222a405-a086-4874-841c-4743b4fbcef4 req-f448f9e6-1007-42bc-83a5-821411217519 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 for instance with vm_state building and task_state spawning. Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:32:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance running successfully. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Failed to set time: agent not configured {{(pid=75021) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-66f46bc5-8869-4024-b9ba-badb359a27a3 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] finish_migration finished successfully. {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:27 user nova-compute[75021]: WARNING nova.compute.manager [req-cc929d65-47cd-41a2-8520-cf1f217852ce req-42fe390f-ef18-4503-9086-b871bfe79caa service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a for instance with vm_state building and task_state spawning. Nov 30 06:32:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:32:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance spawned successfully. Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:28 user nova-compute[75021]: INFO nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Took 14.02 seconds to spawn the instance on the hypervisor. Nov 30 06:32:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:32:28 user nova-compute[75021]: INFO nova.compute.manager [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Took 44.80 seconds to build instance. Nov 30 06:32:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a655651-4701-4e5d-b99a-f8a60501987f tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 44.916s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-changed-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Refreshing instance network info cache due to event network-changed-45cc5eb4-5588-4c0a-806a-979fee73c91b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] Acquiring lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] Acquired lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Refreshing network info cache for port 45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updated VIF entry in instance network info cache for port 45cc5eb4-5588-4c0a-806a-979fee73c91b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating instance_info_cache with network_info: [{"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-259a45b9-323e-45a1-8ef2-f4edf00b11e5 req-b8f500fa-9a60-481b-af2e-b4495f2a1226 service nova] Releasing lock "refresh_cache-f7b6383f-a916-400f-8424-54fbbffec7b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.073s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:31 user nova-compute[75021]: INFO nova.compute.manager [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attaching volume e838b0aa-5009-435c-8102-b183d1e631cb to /dev/vdb Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.utils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca8471-2050-42fc-8f6f-32c503e1e5ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8483c682-7b94-49bf-92dd-c956c5ff6ef8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e74f78-6e0d-43ef-aa31-24699bc47f3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0299ba3-753b-4d83-88c2-3699c028e70a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:31 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:32:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59232f-f0b2-4efa-8101-b89cabc73b0b]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG os_brick.utils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:31 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating existing volume attachment record: 1b8f9218-a8b6-41b6-bddd-05afc6782955 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:32:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:32:38 user nova-compute[75021]: INFO nova.compute.manager [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] instance snapshotting Nov 30 06:32:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Beginning live snapshot process Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.233s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93.delta 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93.delta 1073741824" returned: 0 in 0.107s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Quiescing instance not available: QEMU guest agent is not enabled. Nov 30 06:32:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] COPY block job progress, current cursor: 47775744 final cursor: 75563008 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHPqEZfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:41 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:32:41 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c168a96-1142-4c5e-a798-714dd603a190]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:32:41 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19702d2-37d5-4827-a325-7f645d397014]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb] added Nov 30 06:32:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[323a2f95-ca1e-4f1f-9f36-3c8e66a393e6]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}} Nov 30 06:32:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4065f-df4b-4911-b16b-44b4eff32772]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHPqEZfz {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHPqEZfz" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf30bd-726a-474a-9974-1797ae85a586]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uHPqEZfz'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b3950d-09be-4511-a6ec-30c56f673467]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d936f-903a-4359-8411-a6e6430d9f7d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93.delta /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c2d78d-cbb8-478f-a3ba-e27ee5fd55c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] Nov 30 06:32:42 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] successful. Nov 30 06:32:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[377617e8-4d04-4292-a9eb-a9d425f191c2]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d518854-26d7-4c04-8544-ee5092a9965c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:32:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:32:42 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:32:42 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6f4dc8-1834-4909-a622-64c425a8391a]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHPqEZfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:32:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93.delta /opt/stack/data/nova/instances/snapshots/tmpd3b2m8wv/cbc2f1ab59b64f0e8196ad5596425c93" returned: 0 in 0.741s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Snapshot extracted, beginning image upload Nov 30 06:32:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26264643631383036', 'path': '/dev/sdg'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264643631383036', 'path': '/dev/sdg'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] attach device xml: Nov 30 06:32:43 user nova-compute[75021]: Nov 30 06:32:43 user nova-compute[75021]: Nov 30 06:32:43 user nova-compute[75021]: Nov 30 06:32:43 user nova-compute[75021]: e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:32:43 user nova-compute[75021]: Nov 30 06:32:43 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No VIF found with MAC fa:16:3e:26:6c:1a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:32:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5081550c-02ba-4689-9015-a5af12ecee9e tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 12.819s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Snapshot image upload complete Nov 30 06:32:46 user nova-compute[75021]: INFO nova.compute.manager [None req-beb25d6d-bb82-4996-9068-aa1c8ff8e97a tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: b23fb096-817f-4e68-a725-91a7492c5f48] Took 7.78 seconds to snapshot the instance on the hypervisor. Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.092s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:49 user nova-compute[75021]: INFO nova.compute.manager [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attaching volume d596a3b6-810a-42e2-8482-026b8431d6ec to /dev/vdc Nov 30 06:32:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29658ace-0042-4033-bfb2-a159de13c289]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebfc510-d9a5-456e-8277-ad28de464b92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:32:49 user nova-compute[75021]: INFO nova.compute.claims [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Claim successful on node user Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8bbe3-9748-4bf7-8ccd-a9a94dd4e48a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd87112-6aa6-4da1-ae88-31b3b59feebe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:32:49 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:32:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ed012-0d9d-4071-bef4-5718c5d1544a]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:32:49 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating existing volume attachment record: c6ba7387-caee-4502-ace5-18d49e4ab7ab {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:32:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.policy [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a7a8896ae7b4265aa37385aa71b470d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ae80ead9b4608b5ecf5054d70865e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:32:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Creating image(s) Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "/opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "/opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "/opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.042s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG nova.virt.images [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] 5b769094-dcea-433f-8e04-103b7a1e159d was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Nov 30 06:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.part /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Successfully created port: c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.part /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.converted" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.692s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json" returned: 0 in 0.237s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14,backing_fmt=raw /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14,backing_fmt=raw /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk 1073741824" returned: 0 in 0.054s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "b6e0508c0e0b35293c70d092d35434f9ae5f5f14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.298s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6e0508c0e0b35293c70d092d35434f9ae5f5f14 --force-share --output=json" returned: 0 in 0.247s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Ensure instance console log exists: /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Successfully updated port: c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquired lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received event network-changed-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Refreshing instance network info cache due to event network-changed-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] Acquiring lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.neutron [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updating instance_info_cache with network_info: [{"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Releasing lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Instance network_info: |[{"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] Acquired lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.neutron [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Refreshing network info cache for port c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Start _get_guest_xml network_info=[{"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5fe5f81ace74d0959b1dcbc87f30b478',container_format='bare',created_at=2023-11-30T06:32:38Z,direct_url=,disk_format='qcow2',id=5b769094-dcea-433f-8e04-103b7a1e159d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-397797871',owner='482ae80ead9b4608b5ecf5054d70865e',properties=ImageMetaProps,protected=,size=52363264,status='active',tags=,updated_at=2023-11-30T06:32:46Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '5b769094-dcea-433f-8e04-103b7a1e159d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:32:54 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:54 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5fe5f81ace74d0959b1dcbc87f30b478',container_format='bare',created_at=2023-11-30T06:32:38Z,direct_url=,disk_format='qcow2',id=5b769094-dcea-433f-8e04-103b7a1e159d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-397797871',owner='482ae80ead9b4608b5ecf5054d70865e',properties=ImageMetaProps,protected=,size=52363264,status='active',tags=,updated_at=2023-11-30T06:32:46Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1265441171',display_name='tempest-TestStampPattern-server-1265441171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1265441171',id=15,image_ref='5b769094-dcea-433f-8e04-103b7a1e159d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+Y5ALIhhKR4M2yTQx/yWsRKdaMtTkkeMHx8QCJTJ763UDOjVxC1bHYSkNoRHp/Ep/ds88FbZXmdqEd/nr8gIaylencpleh8FHOf6KXXzZrhaVX3+0SrpCM7+Spj6IBA==',key_name='tempest-TestStampPattern-1630726288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ae80ead9b4608b5ecf5054d70865e',ramdisk_id='',reservation_id='r-c9jn7cjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b23fb096-817f-4e68-a725-91a7492c5f48',image_min_disk='1',image_min_ram='0',image_owner_id='482ae80ead9b4608b5ecf5054d70865e',image_owner_project_name='tempest-TestStampPattern-1491533737',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1491533737-project-member',image_user_id='1a7a8896ae7b4265aa37385aa71b470d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1491533737',owner_user_name='tempest-TestStampPattern-1491533737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:32:50Z,user_data=None,user_id='1a7a8896ae7b4265aa37385aa71b470d',uuid=6db4aa82-04c5-4553-b3c4-64ce905085be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converting VIF {"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:61:d4,bridge_name='br-int',has_traffic_filtering=True,id=c2dc1b6a-28a3-4073-89e4-4323f7bbe40a,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2dc1b6a-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'pci_devices' on Instance uuid 6db4aa82-04c5-4553-b3c4-64ce905085be {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] End _get_guest_xml xml= Nov 30 06:32:54 user nova-compute[75021]: 6db4aa82-04c5-4553-b3c4-64ce905085be Nov 30 06:32:54 user nova-compute[75021]: instance-0000000f Nov 30 06:32:54 user nova-compute[75021]: 524288 Nov 30 06:32:54 user nova-compute[75021]: 1 Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: tempest-TestStampPattern-server-1265441171 Nov 30 06:32:54 user nova-compute[75021]: 2023-11-30 06:32:54 Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: 512 Nov 30 06:32:54 user nova-compute[75021]: 1 Nov 30 06:32:54 user nova-compute[75021]: 0 Nov 30 06:32:54 user nova-compute[75021]: 0 Nov 30 06:32:54 user nova-compute[75021]: 1 Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: tempest-TestStampPattern-1491533737-project-member Nov 30 06:32:54 user nova-compute[75021]: tempest-TestStampPattern-1491533737 Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: OpenStack Foundation Nov 30 06:32:54 user nova-compute[75021]: OpenStack Nova Nov 30 06:32:54 user nova-compute[75021]: 0.0.0 Nov 30 06:32:54 user nova-compute[75021]: 6db4aa82-04c5-4553-b3c4-64ce905085be Nov 30 06:32:54 user nova-compute[75021]: 6db4aa82-04c5-4553-b3c4-64ce905085be Nov 30 06:32:54 user nova-compute[75021]: Virtual Machine Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: hvm Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nehalem Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: /dev/urandom Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: Nov 30 06:32:54 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1265441171',display_name='tempest-TestStampPattern-server-1265441171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1265441171',id=15,image_ref='5b769094-dcea-433f-8e04-103b7a1e159d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+Y5ALIhhKR4M2yTQx/yWsRKdaMtTkkeMHx8QCJTJ763UDOjVxC1bHYSkNoRHp/Ep/ds88FbZXmdqEd/nr8gIaylencpleh8FHOf6KXXzZrhaVX3+0SrpCM7+Spj6IBA==',key_name='tempest-TestStampPattern-1630726288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ae80ead9b4608b5ecf5054d70865e',ramdisk_id='',reservation_id='r-c9jn7cjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b23fb096-817f-4e68-a725-91a7492c5f48',image_min_disk='1',image_min_ram='0',image_owner_id='482ae80ead9b4608b5ecf5054d70865e',image_owner_project_name='tempest-TestStampPattern-1491533737',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1491533737-project-member',image_user_id='1a7a8896ae7b4265aa37385aa71b470d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1491533737',owner_user_name='tempest-TestStampPattern-1491533737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:32:50Z,user_data=None,user_id='1a7a8896ae7b4265aa37385aa71b470d',uuid=6db4aa82-04c5-4553-b3c4-64ce905085be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converting VIF {"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:61:d4,bridge_name='br-int',has_traffic_filtering=True,id=c2dc1b6a-28a3-4073-89e4-4323f7bbe40a,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2dc1b6a-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG os_vif [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:61:d4,bridge_name='br-int',has_traffic_filtering=True,id=c2dc1b6a-28a3-4073-89e4-4323f7bbe40a,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2dc1b6a-28') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd26b8faf-df27-5bc1-9478-d487fe8ed64e', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2dc1b6a-28, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2dc1b6a-28, col_values=(('qos', UUID('bba28532-d7b7-45b9-91df-7d6054114032')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2dc1b6a-28, col_values=(('external_ids', {'iface-id': 'c2dc1b6a-28a3-4073-89e4-4323f7bbe40a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:61:d4', 'vm-uuid': '6db4aa82-04c5-4553-b3c4-64ce905085be'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:54 user nova-compute[75021]: INFO os_vif [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:61:d4,bridge_name='br-int',has_traffic_filtering=True,id=c2dc1b6a-28a3-4073-89e4-4323f7bbe40a,network=Network(cb662fc9-d454-403a-b88a-095e4b6efc84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2dc1b6a-28') Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No VIF found with MAC fa:16:3e:ab:61:d4, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.neutron [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updated VIF entry in instance network info cache for port c2dc1b6a-28a3-4073-89e4-4323f7bbe40a. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG nova.network.neutron [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updating instance_info_cache with network_info: [{"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5709027-97ea-4138-a192-d406fb09bb9c req-95da89ae-43f4-441f-845a-80b71ea43260 service nova] Releasing lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received event network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] No waiting events found dispatching network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:55 user nova-compute[75021]: WARNING nova.compute.manager [req-a9c379a2-b20b-466b-ab6b-015c2af514f0 req-507f5279-2f51-400e-bbad-5a74dedd2d4c service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received unexpected event network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a for instance with vm_state building and task_state spawning. Nov 30 06:32:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:32:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received event network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] No waiting events found dispatching network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:32:58 user nova-compute[75021]: WARNING nova.compute.manager [req-73d85f96-5f4a-40b6-90bb-225527b4e50f req-d737bb2a-aa39-4a8b-bf2d-0c7a3bb16c75 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received unexpected event network-vif-plugged-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a for instance with vm_state building and task_state spawning. Nov 30 06:32:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Instance spawned successfully. Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:32:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7225MB free_disk=25.305782318115234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:32:58 user nova-compute[75021]: INFO nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Took 7.75 seconds to spawn the instance on the hypervisor. Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Applying migration context for instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 as it has an incoming, in-progress migration 31a5e434-0aed-46ca-9e82-b392ca96821d. Migration status is finished {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}} Nov 30 06:32:58 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating resource usage from migration 31a5e434-0aed-46ca-9e82-b392ca96821d Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance f7b6383f-a916-400f-8424-54fbbffec7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c4096501-058e-4353-aad7-4ee70fdd18ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 762ed361-1cae-4274-a9af-81f4533ca75a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c811878a-676f-43ed-ba7f-2b765a3c51bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Migration 31a5e434-0aed-46ca-9e82-b392ca96821d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 6db4aa82-04c5-4553-b3c4-64ce905085be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:32:58 user nova-compute[75021]: INFO nova.compute.manager [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Took 8.92 seconds to build instance. Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c507fb9b-7c52-4e45-88b8-eadb9897dacd tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 9.055s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:32:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:32:59 user nova-compute[75021]: INFO nova.compute.claims [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Claim successful on node user Nov 30 06:32:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:32:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.policy [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '721151a878614471a6b52a1cde234efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b161726bbb4145a583b93842478bece0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:32:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Creating image(s) Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "/opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "/opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "/opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "d69665128130ac0235c631fff0e7aecf12e254ff" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:32:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "d69665128130ac0235c631fff0e7aecf12e254ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG nova.virt.images [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] f7d4393b-8c44-4952-9931-e908553ab208 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.part /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Successfully created port: 276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.part /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.converted" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating instance_info_cache with network_info: [{"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "d69665128130ac0235c631fff0e7aecf12e254ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.933s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-93976999-56e9-46f0-bf87-ef5b794f7a38" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:00 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "d69665128130ac0235c631fff0e7aecf12e254ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "d69665128130ac0235c631fff0e7aecf12e254ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Successfully updated port: 276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquired lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received event network-changed-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Refreshing instance network info cache due to event network-changed-276d3842-23e2-4028-8bed-44014bb20232. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] Acquiring lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff,backing_fmt=raw /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff,backing_fmt=raw /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk 1073741824" returned: 0 in 0.057s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "d69665128130ac0235c631fff0e7aecf12e254ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.257s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d69665128130ac0235c631fff0e7aecf12e254ff --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updating instance_info_cache with network_info: [{"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Releasing lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Instance network_info: |[{"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] Acquired lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Refreshing network info cache for port 276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Cannot resize image /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Ensure instance console log exists: /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Start _get_guest_xml network_info=[{"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:32:54Z,direct_url=,disk_format='qcow2',id=f7d4393b-8c44-4952-9931-e908553ab208,min_disk=0,min_ram=0,name='',owner='fa45d6f78c3a4935859c711606bcd46d',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:32:56Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/sda', 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': 'f7d4393b-8c44-4952-9931-e908553ab208'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:33:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:33:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:32:54Z,direct_url=,disk_format='qcow2',id=f7d4393b-8c44-4952-9931-e908553ab208,min_disk=0,min_ram=0,name='',owner='fa45d6f78c3a4935859c711606bcd46d',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:32:56Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1666558999',display_name='tempest-AttachSCSIVolumeTestJSON-server-1666558999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1666558999',id=16,image_ref='f7d4393b-8c44-4952-9931-e908553ab208',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFrpIkNzWZDtyXgBMyJoh6SVm9HOWKLG76MGpUaDPTYLoQUzz2rdgwIvHVWcXISrY7jFBVhSQ374QkaAd4ap9O0/6m9HeRAJhdlHdODzHOD2Fff+huD/+SlFix2pTSCWw==',key_name='tempest-keypair-875845839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b161726bbb4145a583b93842478bece0',ramdisk_id='',reservation_id='r-gxql421y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7d4393b-8c44-4952-9931-e908553ab208',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-779939869',owner_user_name='tempest-AttachSCSIVolumeTestJSON-779939869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='721151a878614471a6b52a1cde234efc',uuid=906a06e5-395d-4a0f-a56c-58b53a0f59f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Converting VIF {"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:90:17,bridge_name='br-int',has_traffic_filtering=True,id=276d3842-23e2-4028-8bed-44014bb20232,network=Network(143ad363-94b3-4a4c-aef6-b388041512a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d3842-23') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lazy-loading 'pci_devices' on Instance uuid 906a06e5-395d-4a0f-a56c-58b53a0f59f2 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] End _get_guest_xml xml= Nov 30 06:33:01 user nova-compute[75021]: 906a06e5-395d-4a0f-a56c-58b53a0f59f2 Nov 30 06:33:01 user nova-compute[75021]: instance-00000010 Nov 30 06:33:01 user nova-compute[75021]: 524288 Nov 30 06:33:01 user nova-compute[75021]: 1 Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: tempest-AttachSCSIVolumeTestJSON-server-1666558999 Nov 30 06:33:01 user nova-compute[75021]: 2023-11-30 06:33:01 Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: 512 Nov 30 06:33:01 user nova-compute[75021]: 1 Nov 30 06:33:01 user nova-compute[75021]: 0 Nov 30 06:33:01 user nova-compute[75021]: 0 Nov 30 06:33:01 user nova-compute[75021]: 1 Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: tempest-AttachSCSIVolumeTestJSON-779939869-project-member Nov 30 06:33:01 user nova-compute[75021]: tempest-AttachSCSIVolumeTestJSON-779939869 Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: OpenStack Foundation Nov 30 06:33:01 user nova-compute[75021]: OpenStack Nova Nov 30 06:33:01 user nova-compute[75021]: 0.0.0 Nov 30 06:33:01 user nova-compute[75021]: 906a06e5-395d-4a0f-a56c-58b53a0f59f2 Nov 30 06:33:01 user nova-compute[75021]: 906a06e5-395d-4a0f-a56c-58b53a0f59f2 Nov 30 06:33:01 user nova-compute[75021]: Virtual Machine Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: hvm Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nehalem Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]:
Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]:
Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: /dev/urandom Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: Nov 30 06:33:01 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1666558999',display_name='tempest-AttachSCSIVolumeTestJSON-server-1666558999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1666558999',id=16,image_ref='f7d4393b-8c44-4952-9931-e908553ab208',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFrpIkNzWZDtyXgBMyJoh6SVm9HOWKLG76MGpUaDPTYLoQUzz2rdgwIvHVWcXISrY7jFBVhSQ374QkaAd4ap9O0/6m9HeRAJhdlHdODzHOD2Fff+huD/+SlFix2pTSCWw==',key_name='tempest-keypair-875845839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b161726bbb4145a583b93842478bece0',ramdisk_id='',reservation_id='r-gxql421y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7d4393b-8c44-4952-9931-e908553ab208',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-779939869',owner_user_name='tempest-AttachSCSIVolumeTestJSON-779939869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='721151a878614471a6b52a1cde234efc',uuid=906a06e5-395d-4a0f-a56c-58b53a0f59f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Converting VIF {"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:90:17,bridge_name='br-int',has_traffic_filtering=True,id=276d3842-23e2-4028-8bed-44014bb20232,network=Network(143ad363-94b3-4a4c-aef6-b388041512a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d3842-23') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG os_vif [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:90:17,bridge_name='br-int',has_traffic_filtering=True,id=276d3842-23e2-4028-8bed-44014bb20232,network=Network(143ad363-94b3-4a4c-aef6-b388041512a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d3842-23') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94d034fa-269c-5e73-9d51-19cbe0e08dbd', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap276d3842-23, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap276d3842-23, col_values=(('qos', UUID('75ff58c0-f80e-4535-bd4a-d73bbaf61ff9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap276d3842-23, col_values=(('external_ids', {'iface-id': '276d3842-23e2-4028-8bed-44014bb20232', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:90:17', 'vm-uuid': '906a06e5-395d-4a0f-a56c-58b53a0f59f2'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:02 user nova-compute[75021]: INFO os_vif [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:90:17,bridge_name='br-int',has_traffic_filtering=True,id=276d3842-23e2-4028-8bed-44014bb20232,network=Network(143ad363-94b3-4a4c-aef6-b388041512a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d3842-23') Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] No BDM found with device name sda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] No VIF found with MAC fa:16:3e:eb:90:17, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:33:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Using config drive Nov 30 06:33:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Creating config drive at /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.config Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm19mx4mx {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm19mx4mx" returned: 0 in 0.065s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updated VIF entry in instance network info cache for port 276d3842-23e2-4028-8bed-44014bb20232. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updating instance_info_cache with network_info: [{"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5627ca45-75c9-4d49-8d29-866683fa166a req-4ac29a21-c419-4582-b2ff-6d86ec556eb8 service nova] Releasing lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJbvSjse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:02 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:02 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:02 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ca153d-72d6-4d71-b8d9-ca7e2fa2cbb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:33:02 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1da07f8-0177-45e6-a6ff-c37ae40c606e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec] added Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb919129-f75b-44cf-83a3-c2e03495a496]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1769f-88ec-4763-86d9-3932762093d0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJbvSjse {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJbvSjse" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82a645c-773d-40d3-ab40-33ff29c17d96]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJbvSjse'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059e820-77ed-4001-b5f2-a97f298b1bd7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ffa6ed-167d-4e5d-a0df-512a2e3e03b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[870afac8-dd0a-4a74-8dd6-c632e24167f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] Nov 30 06:33:03 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] successful. Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3973a5-f959-4028-a662-4f9cd107f157]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba5f46-d24c-48d4-95b2-36f5954126d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash) Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:03 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash) Nov 30 06:33:03 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf453c-7959-47f3-a596-9042fc07c3f2]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJbvSjse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received event network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] No waiting events found dispatching network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:04 user nova-compute[75021]: WARNING nova.compute.manager [req-87c15df9-5c88-41c7-b9eb-ba17a42b3884 req-de71c6fd-f4a5-49b8-805e-869840727bab service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received unexpected event network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 for instance with vm_state building and task_state spawning. Nov 30 06:33:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26461313434663230', 'path': '/dev/sdh'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461313434663230', 'path': '/dev/sdh'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] attach device xml: Nov 30 06:33:04 user nova-compute[75021]: Nov 30 06:33:04 user nova-compute[75021]: Nov 30 06:33:04 user nova-compute[75021]: Nov 30 06:33:04 user nova-compute[75021]: d596a3b6-810a-42e2-8482-026b8431d6ec Nov 30 06:33:04 user nova-compute[75021]: Nov 30 06:33:04 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] No VIF found with MAC fa:16:3e:26:6c:1a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:33:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f4573b54-327d-409f-9431-016df8e6f916 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 15.538s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:06 user nova-compute[75021]: INFO nova.compute.manager [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Detaching volume d596a3b6-810a-42e2-8482-026b8431d6ec Nov 30 06:33:06 user nova-compute[75021]: INFO nova.virt.block_device [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attempting to driver detach volume d596a3b6-810a-42e2-8482-026b8431d6ec from mountpoint /dev/vdc Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Attempting to detach device vdc from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] detach device xml: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: d596a3b6-810a-42e2-8482-026b8431d6ec Nov 30 06:33:06 user nova-compute[75021]:
Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received event network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] No waiting events found dispatching network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:06 user nova-compute[75021]: WARNING nova.compute.manager [req-9cce27d2-e5e8-4a32-8924-6d681e58759d req-656767e2-43c7-4ff6-adce-e4fc1ed9c78a service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received unexpected event network-vif-plugged-276d3842-23e2-4028-8bed-44014bb20232 for instance with vm_state building and task_state spawning. Nov 30 06:33:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully detached device vdc from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the persistent domain config. Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] detach device xml: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: d596a3b6-810a-42e2-8482-026b8431d6ec Nov 30 06:33:06 user nova-compute[75021]:
Nov 30 06:33:06 user nova-compute[75021]: Nov 30 06:33:06 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:33:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Instance spawned successfully. Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:33:06 user nova-compute[75021]: INFO nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Took 6.62 seconds to spawn the instance on the hypervisor. Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:33:06 user nova-compute[75021]: INFO nova.compute.manager [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Took 7.56 seconds to build instance. Nov 30 06:33:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d93c9c0a-5707-4ac6-9c73-eccf4f217665 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 7.695s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:33:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}} Nov 30 06:33:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:15 user nova-compute[75021]: INFO nova.compute.manager [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Terminating instance Nov 30 06:33:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Instance destroyed successfully. Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.objects.instance [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'resources' on Instance uuid c4096501-058e-4353-aad7-4ee70fdd18ec {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850921392',display_name='tempest-VolumesAdminNegativeTest-server-1850921392',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850921392',id=12,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2023-11-30T06:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-nfka30h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:31:22Z,user_data=None,user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=c4096501-058e-4353-aad7-4ee70fdd18ec,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "address": "fa:16:3e:c4:b3:d7", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4135b7-51", "ovs_interfaceid": "5e4135b7-5100-4e1e-bbf5-8933f8f5a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG os_vif [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4135b7-51, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a2d1e34-963e-4d1a-b90e-8893871a79e1) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: INFO os_vif [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b3:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e4135b7-5100-4e1e-bbf5-8933f8f5a3de,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4135b7-51') Nov 30 06:33:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Deleting instance files /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec_del Nov 30 06:33:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Deletion of /opt/stack/data/nova/instances/c4096501-058e-4353-aad7-4ee70fdd18ec_del complete Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-unplugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] No waiting events found dispatching network-vif-unplugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-06b74ea0-2676-4e47-9bd9-f11d6e1d6161 req-e6f479c1-e791-4cb8-9da8-3bd8bd7f1ffc service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-unplugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:16 user nova-compute[75021]: INFO nova.compute.manager [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Took 0.79 seconds to destroy the instance on the hypervisor. Nov 30 06:33:16 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:16 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:16 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Took 0.52 seconds to deallocate network for instance. Nov 30 06:33:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-87c69f07-d4e2-4844-a7c6-6d81e6a58b94 req-d7c608bf-ab5b-4c36-bf1e-976edd8b1615 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-deleted-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:33:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:33:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:17 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Deleted allocations for instance c4096501-058e-4353-aad7-4ee70fdd18ec Nov 30 06:33:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75a90494-5f50-48d5-8498-c781b94e4681 tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 2.046s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] Acquiring lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] Lock "c4096501-058e-4353-aad7-4ee70fdd18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] No waiting events found dispatching network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:18 user nova-compute[75021]: WARNING nova.compute.manager [req-b88cc3f2-5456-454f-83c8-4f6d6117d19f req-05ee6e53-0bee-4a79-a635-64d14a52f5a6 service nova] [instance: c4096501-058e-4353-aad7-4ee70fdd18ec] Received unexpected event network-vif-plugged-5e4135b7-5100-4e1e-bbf5-8933f8f5a3de for instance with vm_state deleted and task_state None. Nov 30 06:33:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f7b6383f-a916-400f-8424-54fbbffec7b8 is timed out. Nov 30 06:33:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully detached device vdc from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the live domain config. Nov 30 06:33:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJbvSjse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f53fe2-0582-4fc8-8828-f5945624eca2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:26 user nova-compute[75021]: No targets found. Nov 30 06:33:26 user nova-compute[75021]: iSNS: Nov 30 06:33:26 user nova-compute[75021]: No targets found. Nov 30 06:33:26 user nova-compute[75021]: STATIC: Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:26 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:26 user nova-compute[75021]: Iface Name: default Nov 30 06:33:26 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:26 user nova-compute[75021]: No targets found. Nov 30 06:33:26 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:26 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:26 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa7139-e5ca-49d9-9423-be5fe775bfc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a76c9-402c-44f4-b8dd-a3f562f9279a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash) Nov 30 06:33:26 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:26 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec (non-flash) Nov 30 06:33:26 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Resulting device map defaultdict(. at 0x7f0000254ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec'): ({'sdh'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Removing single pathed devices sdh {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c9086-ac3e-43fb-a20a-0a7db9f9ddfe]: (4, ('path checker states:\nup 8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d3efa9-56a8-4545-bbfd-067a35212eea]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Flushing IO for device /dev/sdh {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde17be2-e5e0-4928-829b-30e3f57ab5ac]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b9a438-b98b-4b58-954c-979dbd063f30]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456e597-6158-4bbb-914e-4d1490ec500f]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be0447-941b-499a-8a35-e9093bd971a2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] Nov 30 06:33:27 user nova-compute[75021]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec, portal: 172.16.0.220,3260] successful. Nov 30 06:33:27 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d596a3b6-810a-42e2-8482-026b8431d6ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abd89f0-3b72-4217-906f-215de6a1ef17]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== disconnect_volume: return (366ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:28 user nova-compute[75021]: DEBUG nova.objects.instance [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-00df6aa1-7bed-4d9c-85a6-e37b0697b78b tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.099s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-changed-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing instance network info cache due to event network-changed-73a71cb4-81fa-4228-a175-1452b5f26c9f. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] Acquiring lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] Acquired lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Refreshing network info cache for port 73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updated VIF entry in instance network info cache for port 73a71cb4-81fa-4228-a175-1452b5f26c9f. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb76f782-9972-41de-a0e2-e4a0d0662b69 req-b2d16b85-7053-4ef4-8162-80b629baee69 service nova] Releasing lock "refresh_cache-762ed361-1cae-4274-a9af-81f4533ca75a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:37 user nova-compute[75021]: INFO nova.compute.manager [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Terminating instance Nov 30 06:33:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-66e85853-865f-43d3-a39f-67abafd66ec1 req-d36add3a-390b-45ea-bf86-c1c61f243ac6 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-73a71cb4-81fa-4228-a175-1452b5f26c9f for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-9504abd3-ad6a-4b05-9f6c-37774eab3185 req-cbd97bbd-f060-431b-8413-dd7a3ea8e6a9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-37339b54-cba3-4b15-afef-5519ca06d8e7 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-22e1c90d-7451-44ea-9051-b9abbfabc679 req-0551d133-e15f-4d4b-80ee-2bba07dd3c25 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Instance destroyed successfully. Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lazy-loading 'resources' on Instance uuid 762ed361-1cae-4274-a9af-81f4533ca75a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73a71cb4-81, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fccf4bdc-5e37-4ae8-9605-5c685e655805) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=73a71cb4-81fa-4228-a175-1452b5f26c9f,network=Network(e62b5d52-b141-46f6-8fc2-c2df3d442a31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a71cb4-81') Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cf9163-64, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e47d2af-c6de-4e3a-93bc-81236ab6e611) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cf:51,bridge_name='br-int',has_traffic_filtering=True,id=d0cf9163-64a6-4731-ae86-1b64ec070c49,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0cf9163-64') Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37339b54-cb, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fde1f2f-9c97-481f-a13c-b189ce78bded) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5c:95,bridge_name='br-int',has_traffic_filtering=True,id=37339b54-cba3-4b15-afef-5519ca06d8e7,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37339b54-cb') Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d4c56ec-93, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aacb113-a712-4cae-849c-ff9fefb5da4c) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1c:4d,bridge_name='br-int',has_traffic_filtering=True,id=6d4c56ec-9308-4d24-8af9-48ebef910ba1,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4c56ec-93') Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81667051-ce, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: WARNING nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-73a71cb4-81fa-4228-a175-1452b5f26c9f for instance with vm_state active and task_state deleting. Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: WARNING nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-6d4c56ec-9308-4d24-8af9-48ebef910ba1 for instance with vm_state active and task_state deleting. Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-81667051-ce58-4c05-963a-32393522c451 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: WARNING nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-81667051-ce58-4c05-963a-32393522c451 for instance with vm_state active and task_state deleting. Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-533363e2-40a3-4260-99d8-05505dd7a43a for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:39 user nova-compute[75021]: WARNING nova.compute.manager [req-bc95a602-232e-494b-949e-ef9ed456559c req-1a5bc9b3-dc62-4a7c-9b70-3adbfe86c841 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-533363e2-40a3-4260-99d8-05505dd7a43a for instance with vm_state active and task_state deleting. Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07620d54-2f85-4cf5-aaa3-f4d5bb00df50) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:40:ef,bridge_name='br-int',has_traffic_filtering=True,id=81667051-ce58-4c05-963a-32393522c451,network=Network(ba586ba5-ecfe-49c0-b9b0-55bd784361b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81667051-ce') Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "533363e2-40a3-4260-99d8-05505dd7a43a", "address": "fa:16:3e:95:ee:8f", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap533363e2-40", "ovs_interfaceid": "533363e2-40a3-4260-99d8-05505dd7a43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap533363e2-40, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=181b69b3-ae1b-4f85-b694-0b3273cdad33) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:ee:8f,bridge_name='br-int',has_traffic_filtering=True,id=533363e2-40a3-4260-99d8-05505dd7a43a,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533363e2-40') Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T06:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140011399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140011399',id=13,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghSE8yAE1KNNtihVFKVqeNZ4Ug+UJhVNXOQ/GQg6JIYP89L/YwpGPvXueUgyW/PocpYvgSV+tMTobix3blziXjoXvS4qd0IayXEC0RZlEXNoiWdrOeBQa7vpuKzBcgww==',key_name='tempest-keypair-710730642',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6fe63819ba3243f9ab823325a0e65728',ramdisk_id='',reservation_id='r-jgdir34y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1763169621',owner_user_name='tempest-TaggedBootDevicesTest-1763169621-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b6065dafe28436e916d0174d8f54cd3',uuid=762ed361-1cae-4274-a9af-81f4533ca75a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converting VIF {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa83f0afb-ef, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2889447-16e3-4a7d-a501-02278bfa41ec) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:40 user nova-compute[75021]: INFO os_vif [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:99:b9,bridge_name='br-int',has_traffic_filtering=True,id=a83f0afb-ef7e-49dc-8b62-88c9f8c30889,network=Network(65930b7c-0710-4ea5-ba87-00ee9268f0b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83f0afb-ef') Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKgEYmrH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf555c65-1cc3-4508-8ee0-e375dd095b70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: iSNS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: STATIC: Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:40 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:40 user nova-compute[75021]: WARNING nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-37339b54-cba3-4b15-afef-5519ca06d8e7 for instance with vm_state active and task_state deleting. Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-unplugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-unplugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:40 user nova-compute[75021]: WARNING nova.compute.manager [req-33b05f77-9e63-4b8c-be7a-5e406fe88599 req-400402d3-8e2c-438f-9f5f-fefaaa5afe4c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 for instance with vm_state active and task_state deleting. Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5fc4c-14ef-4f7a-9190-33c5727f6cad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccacd2b9-d5ef-4c77-a773-a17ea9f1e0b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Resulting device map defaultdict(. at 0x7f0000230550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] Acquiring lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] Lock "762ed361-1cae-4274-a9af-81f4533ca75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] No waiting events found dispatching network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:40 user nova-compute[75021]: WARNING nova.compute.manager [req-8d0e52fa-adf4-4b3d-9bed-3e6bf42af12a req-0fa39922-216c-49ae-a98c-d88037eaaf9c service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received unexpected event network-vif-plugged-d0cf9163-64a6-4731-ae86-1b64ec070c49 for instance with vm_state active and task_state deleting. Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc009c-bf47-4d95-947e-bb7aedce3a30]: (4, ('path checker states:\nup 7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f9dad-ba3a-4c20-bc05-1ef8c54973ea]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[318d1513-3bc5-49fa-9c3e-db799fef8293]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c395fa-aa6f-4de8-ab4e-056af154ecc2]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7532951-5152-472b-a634-08588a48ef85]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4ac44-54ca-4380-9dfa-16f260bd2115]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] Nov 30 06:33:40 user nova-compute[75021]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55, portal: 172.16.0.220,3260] successful. Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb9cd9a-130e-4c68-bd98-49639fcdcd55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c51f1-36d4-4be6-9f3d-cfbf0aedee79]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== disconnect_volume: return (416ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANriqVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7063bf-d6dd-40a9-b877-b6156b86f8ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: iSNS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: STATIC: Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:40 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d4f56-1d79-4f39-b32c-b54d95b9c752]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4ad91-73d6-4db9-ad7f-f6b972418225]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:40 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Resulting device map defaultdict(. at 0x7f0000379cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aeb33b-aa3b-43b0-ad0b-1ee80a259e85]: (4, ('path checker states:\nup 6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65361403-8afc-4532-b508-4f9bdec393f0]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89deaf-9c25-4273-80cb-9dd252107a67]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf7926-c27a-4657-bd01-dcd78c091f03]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e9ec54-ae45-4b0c-a3af-9d5d00c79c46]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de8ff7-3bfd-4983-91ce-4e1f83014c8b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] Nov 30 06:33:40 user nova-compute[75021]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3, portal: 172.16.0.220,3260] successful. Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029093ce-51ef-4eee-87b0-fd37109774a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801e404-a386-49e3-bab9-8cd088cdb3fd]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== disconnect_volume: return (383ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'samXuzWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf18a0-c61d-4415-9302-9fbf4ae7b10d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: iSNS: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: STATIC: Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:40 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:40 user nova-compute[75021]: Iface Name: default Nov 30 06:33:40 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:40 user nova-compute[75021]: No targets found. Nov 30 06:33:40 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:40 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:40 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073f176-5805-471c-9965-1cd21471b8d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb34cad-0588-4127-891c-8813882f8fd0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:41 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Resulting device map defaultdict(. at 0x7f0000379cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c1019c-23ea-4312-90e6-089e40b7f776]: (4, ('path checker states:\nup 5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5869d73-f196-4c46-87a9-b15bee446e5a]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.082s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab04753-828e-4fcd-8087-76cec133be11]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce97a2-34c8-4b2b-a506-e2ba235ccf85]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.092s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304985d-098b-41e6-af73-23327f20ffa3]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a87572-90d6-48b5-8de7-fc5fc151cc50]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] Nov 30 06:33:41 user nova-compute[75021]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3, portal: 172.16.0.220,3260] successful. Nov 30 06:33:41 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b57db425-9b9a-4f1a-9ff4-53a8563271d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05651330-83f6-4d8b-a0bf-62ff058f2fb6]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.583s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] <== disconnect_volume: return (584ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Deleting instance files /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a_del Nov 30 06:33:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Deletion of /opt/stack/data/nova/instances/762ed361-1cae-4274-a9af-81f4533ca75a_del complete Nov 30 06:33:41 user nova-compute[75021]: INFO nova.compute.manager [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Took 4.11 seconds to destroy the instance on the hypervisor. Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lazy-loading 'flavor' on Instance uuid c811878a-676f-43ed-ba7f-2b765a3c51bb {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.059s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:41 user nova-compute[75021]: INFO nova.compute.manager [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attaching volume 293fb4cb-a717-4862-ac5f-4815aa33d798 to /dev/vdb Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-changed-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Refreshing instance network info cache due to event network-changed-c85c214d-5540-4ee9-98d8-e6c216dab155. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] Acquiring lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] Acquired lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Refreshing network info cache for port c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.utils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf08e5b4-105c-4747-83f1-0c3db59cb7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9389f4f-83df-4c6a-824f-8a6a9ecc9c60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03360f1-67a3-4ebf-97da-e636de8058a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da8291-4baa-4862-a196-ff870e35a6ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:42 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa89cd8-2c49-4d2c-8e63-4c33e95817c8]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG os_brick.utils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updating existing volume attachment record: 83e97a68-7895-49c8-8ad9-2a8168bfdfa7 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updated VIF entry in instance network info cache for port c85c214d-5540-4ee9-98d8-e6c216dab155. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updating instance_info_cache with network_info: [{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b17c619-6df8-4ca0-996a-b2f18ae6d180 req-1e14701a-8c56-49d2-b200-b92d0903e62f service nova] Releasing lock "refresh_cache-c811878a-676f-43ed-ba7f-2b765a3c51bb" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-515ae645-df4d-49ec-87a9-9dc1fb97623e req-d98e5092-63cd-437e-9c21-00c8bb517249 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-deleted-533363e2-40a3-4260-99d8-05505dd7a43a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:43 user nova-compute[75021]: INFO nova.compute.manager [req-515ae645-df4d-49ec-87a9-9dc1fb97623e req-d98e5092-63cd-437e-9c21-00c8bb517249 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Neutron deleted interface 533363e2-40a3-4260-99d8-05505dd7a43a; detaching it from the instance and deleting it from the info cache Nov 30 06:33:43 user nova-compute[75021]: DEBUG nova.network.neutron [req-515ae645-df4d-49ec-87a9-9dc1fb97623e req-d98e5092-63cd-437e-9c21-00c8bb517249 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81667051-ce58-4c05-963a-32393522c451", "address": "fa:16:3e:20:40:ef", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81667051-ce", "ovs_interfaceid": "81667051-ce58-4c05-963a-32393522c451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-515ae645-df4d-49ec-87a9-9dc1fb97623e req-d98e5092-63cd-437e-9c21-00c8bb517249 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Detach interface failed, port_id=533363e2-40a3-4260-99d8-05505dd7a43a, reason: Instance 762ed361-1cae-4274-a9af-81f4533ca75a could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-deleted-81667051-ce58-4c05-963a-32393522c451 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:45 user nova-compute[75021]: INFO nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Neutron deleted interface 81667051-ce58-4c05-963a-32393522c451; detaching it from the instance and deleting it from the info cache Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "address": "fa:16:3e:e4:f5:5f", "network": {"id": "e62b5d52-b141-46f6-8fc2-c2df3d442a31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2086736826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a71cb4-81", "ovs_interfaceid": "73a71cb4-81fa-4228-a175-1452b5f26c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Detach interface failed, port_id=81667051-ce58-4c05-963a-32393522c451, reason: Instance 762ed361-1cae-4274-a9af-81f4533ca75a could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-deleted-73a71cb4-81fa-4228-a175-1452b5f26c9f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:45 user nova-compute[75021]: INFO nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Neutron deleted interface 73a71cb4-81fa-4228-a175-1452b5f26c9f; detaching it from the instance and deleting it from the info cache Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "address": "fa:16:3e:e1:1c:4d", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4c56ec-93", "ovs_interfaceid": "6d4c56ec-9308-4d24-8af9-48ebef910ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Detach interface failed, port_id=73a71cb4-81fa-4228-a175-1452b5f26c9f, reason: Instance 762ed361-1cae-4274-a9af-81f4533ca75a could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-deleted-6d4c56ec-9308-4d24-8af9-48ebef910ba1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:45 user nova-compute[75021]: INFO nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Neutron deleted interface 6d4c56ec-9308-4d24-8af9-48ebef910ba1; detaching it from the instance and deleting it from the info cache Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [{"id": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "address": "fa:16:3e:c9:cf:51", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cf9163-64", "ovs_interfaceid": "d0cf9163-64a6-4731-ae86-1b64ec070c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37339b54-cba3-4b15-afef-5519ca06d8e7", "address": "fa:16:3e:47:5c:95", "network": {"id": "ba586ba5-ecfe-49c0-b9b0-55bd784361b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-919956842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37339b54-cb", "ovs_interfaceid": "37339b54-cba3-4b15-afef-5519ca06d8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "address": "fa:16:3e:1a:99:b9", "network": {"id": "65930b7c-0710-4ea5-ba87-00ee9268f0b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-784002052", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6fe63819ba3243f9ab823325a0e65728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83f0afb-ef", "ovs_interfaceid": "a83f0afb-ef7e-49dc-8b62-88c9f8c30889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64f6d3af-75cd-43ef-8272-89fdbcf06a88 req-56075fe3-3306-442b-8c8b-e738909fa1b9 service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Detach interface failed, port_id=6d4c56ec-9308-4d24-8af9-48ebef910ba1, reason: Instance 762ed361-1cae-4274-a9af-81f4533ca75a could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:33:45 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Took 3.90 seconds to deallocate network for instance. Nov 30 06:33:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}} Nov 30 06:33:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}} Nov 30 06:33:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-652e7136-18b0-42c6-958b-53548db340ac req-c2b73d47-749b-418c-80e3-2e6b57dbb0bd service nova] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Received event network-vif-deleted-a83f0afb-ef7e-49dc-8b62-88c9f8c30889 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:48 user nova-compute[75021]: INFO nova.compute.manager [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Detaching volume 482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:49 user nova-compute[75021]: INFO nova.virt.block_device [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Attempting to driver detach volume 482c363d-cfed-4540-bfe6-65d877a34c40 from mountpoint /dev/vdb Nov 30 06:33:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Attempting to detach device vdb from instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:33:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] detach device xml: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: 482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:49 user nova-compute[75021]:
Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Successfully detached device vdb from instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 from the persistent domain config. Nov 30 06:33:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:33:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] detach device xml: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: 482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:49 user nova-compute[75021]:
Nov 30 06:33:49 user nova-compute[75021]: Nov 30 06:33:49 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:33:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Port 6588b659-358d-40ed-9176-a98946d4cc7c binding to destination host user is already ACTIVE {{(pid=75021) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Creating tmpfile /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/tmpy6o5vdlc to verify with other compute node that the instance is on the same shared storage. {{(pid=75021) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:52 user nova-compute[75021]: WARNING nova.compute.manager [req-f323c06a-c469-4c49-89ff-32ef42453f0b req-58ce7c84-668b-42f7-ba0d-a53a6750c62b service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-unplugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state resized and task_state resize_reverting. Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:52 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b5b669-24db-4fbb-9337-3085af53d87a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:33:52 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c752f321-11f2-4757-ae91-db00005282d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798] added Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0db9ad-a695-48e2-989e-579e709e704d]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b243bd-caf0-4fa6-81f7-83277d379ff4]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MklrqNKs {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MklrqNKs" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5029501c-6498-49b7-8a91-2cb4da1afb84]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MklrqNKs'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b24d50-6d29-4d35-a430-25c1a3625b90]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb0eb8-0491-4535-b1a5-99b30b67fa0b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8309a855-f6fb-490a-8138-95d28d568393]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] Nov 30 06:33:52 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful. Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf465d10-5db0-43cf-ac25-c9242b42f3b4]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance destroyed successfully. Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'resources' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ac47c-ecc9-49a4-8f6d-789a93f85b33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:52 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:52 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6588b659-35, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58dac384-596a-4c9c-acb0-815262fcccd3) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13d165-f9b7-4fe7-b2a6-2db41e0f0af4]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:52 user nova-compute[75021]: INFO os_vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') Nov 30 06:33:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:33:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:52 user nova-compute[75021]: INFO nova.compute.manager [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] [instance: 762ed361-1cae-4274-a9af-81f4533ca75a] Took 7.51 seconds to detach 3 volumes for instance. Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:53 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Deleted allocations for instance 762ed361-1cae-4274-a9af-81f4533ca75a Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-25189126-c9a7-47f4-8686-6328230e2a3b tempest-TaggedBootDevicesTest-1763169621 tempest-TaggedBootDevicesTest-1763169621-project-member] Lock "762ed361-1cae-4274-a9af-81f4533ca75a" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 16.086s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23736376364393463', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736376364393463', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.994s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lazy-loading 'flavor' on Instance uuid c811878a-676f-43ed-ba7f-2b765a3c51bb {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[891ef7f1-fdbc-417f-9423-d98434665a54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:53 user nova-compute[75021]: No targets found. Nov 30 06:33:53 user nova-compute[75021]: iSNS: Nov 30 06:33:53 user nova-compute[75021]: No targets found. Nov 30 06:33:53 user nova-compute[75021]: STATIC: Nov 30 06:33:53 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:53 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:53 user nova-compute[75021]: Iface Name: default Nov 30 06:33:53 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:33:53 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:53 user nova-compute[75021]: Iface Name: default Nov 30 06:33:53 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:33:53 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:53 user nova-compute[75021]: Iface Name: default Nov 30 06:33:53 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:53 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:53 user nova-compute[75021]: Iface Name: default Nov 30 06:33:53 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:53 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:53 user nova-compute[75021]: Iface Name: default Nov 30 06:33:53 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:53 user nova-compute[75021]: No targets found. Nov 30 06:33:53 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:53 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:53 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] attach device xml: Nov 30 06:33:53 user nova-compute[75021]: Nov 30 06:33:53 user nova-compute[75021]: Nov 30 06:33:53 user nova-compute[75021]: Nov 30 06:33:53 user nova-compute[75021]: 293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:33:53 user nova-compute[75021]: Nov 30 06:33:53 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acc87c-b74d-4c02-b08b-bf7d6474bb28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527b6d7-bb36-4926-aa8a-ae6078cad631]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:53 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:53 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Resulting device map defaultdict(. at 0x7f0000331240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf798477-ac77-4df2-bae3-3e80af1faab8]: (4, ('path checker states:\nup 5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcd906-45ff-425a-9fd4-0b5838fbb665]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05117070-fec9-4b9d-b5a7-71a49ffd68c6]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08551e0-ea94-4d6f-8e32-c1f055ed54ad]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4c323-9333-4633-b891-a8eddd6da8e0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcacdde7-c8f0-48da-af48-ced71219600a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] Nov 30 06:33:53 user nova-compute[75021]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful. Nov 30 06:33:53 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dab676-434d-4a70-a9e5-8d179766df93]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== disconnect_volume: return (1314ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No VIF found with MAC fa:16:3e:5d:61:94, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:54 user nova-compute[75021]: WARNING nova.compute.manager [req-0d39531f-718d-4e49-8aeb-9818cba1a164 req-8cd7f2d9-4ba1-4f04-823b-1509c41580e4 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state resized and task_state resize_reverting. Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-defbecbd-00d9-4818-b62c-ac6177a643e9 tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 12.229s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'migration_context' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG nova.objects.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Object Instance<8e38220a-0fa9-4c33-a344-c421d3bfb638> lazy-loaded attributes: resources,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.714s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:55 user nova-compute[75021]: INFO nova.compute.manager [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Swapping old allocation on dict_keys(['c24a175c-4584-420f-87fd-9adb114da12c']) held by migration 31a5e434-0aed-46ca-9e82-b392ca96821d for instance Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:55 user nova-compute[75021]: INFO nova.compute.manager [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Rebuilding instance Nov 30 06:33:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Overwriting current allocation {'allocations': {'c24a175c-4584-420f-87fd-9adb114da12c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': '3936fa50a9544fcb9aaf6f46d45eda7f', 'user_id': 'dbc2e83db92a4551a7aabdf1111ecdc5', 'consumer_generation': 1} on consumer 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}} Nov 30 06:33:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquired lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-unplugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-unplugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:56 user nova-compute[75021]: WARNING nova.compute.manager [req-6c2a698c-b205-42ab-bd0c-9eee67cdbe2e req-a127bf3c-4cfd-421f-a1fe-8bd8f2216c2a service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-unplugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state active and task_state rebuilding. Nov 30 06:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:56 user nova-compute[75021]: INFO nova.compute.manager [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Detaching volume e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: INFO nova.virt.block_device [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Attempting to driver detach volume e838b0aa-5009-435c-8102-b183d1e631cb from mountpoint /dev/vdb Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance_info_cache with network_info: [{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Attempting to detach device vdb from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] detach device xml: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:56 user nova-compute[75021]:
Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Releasing lock "refresh_cache-8e38220a-0fa9-4c33-a344-c421d3bfb638" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.utils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully detached device vdb from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the persistent domain config. Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] detach device xml: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:56 user nova-compute[75021]:
Nov 30 06:33:56 user nova-compute[75021]: Nov 30 06:33:56 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139a089-417a-4b75-ac20-b2aea66621bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba023b-04fb-40e3-a73b-4b354ac5632d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance destroyed successfully. Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498ec61-9959-49b6-b7ec-83001acd2e2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d46c6-d698-4474-a1be-ce2e6317242b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:56 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:33:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e609a-37a6-4318-868a-44ffc496b1c9]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:33:56 user nova-compute[75021]: DEBUG os_brick.utils [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:57 user nova-compute[75021]: INFO nova.compute.manager [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Detaching volume 293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: INFO nova.virt.block_device [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attempting to driver detach volume 293fb4cb-a717-4862-ac5f-4815aa33d798 from mountpoint /dev/vdb Nov 30 06:33:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Attempting to detach device vdb from instance c811878a-676f-43ed-ba7f-2b765a3c51bb from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] detach device xml: Nov 30 06:33:57 user nova-compute[75021]: Nov 30 06:33:57 user nova-compute[75021]: Nov 30 06:33:57 user nova-compute[75021]: Nov 30 06:33:57 user nova-compute[75021]: 293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:33:57 user nova-compute[75021]:
Nov 30 06:33:57 user nova-compute[75021]: Nov 30 06:33:57 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:33:57 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Successfully detached device vdb from instance c811878a-676f-43ed-ba7f-2b765a3c51bb from the persistent domain config. Nov 30 06:33:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[11993064-4b37-40a6-b9bb-08470e2c4de1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:57 user nova-compute[75021]: No targets found. Nov 30 06:33:57 user nova-compute[75021]: iSNS: Nov 30 06:33:57 user nova-compute[75021]: No targets found. Nov 30 06:33:57 user nova-compute[75021]: STATIC: Nov 30 06:33:57 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:57 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:57 user nova-compute[75021]: Iface Name: default Nov 30 06:33:57 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:33:57 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:57 user nova-compute[75021]: Iface Name: default Nov 30 06:33:57 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:57 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:57 user nova-compute[75021]: Iface Name: default Nov 30 06:33:57 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:57 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:57 user nova-compute[75021]: Iface Name: default Nov 30 06:33:57 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:57 user nova-compute[75021]: No targets found. Nov 30 06:33:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:57 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:57 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f146ace-6491-437c-8ff9-4f477d899855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4cca8-db8f-410d-9090-313bbdeb796a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:57 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:33:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Resulting device map defaultdict(. at 0x7f000012bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a27ae6-87c3-43c3-a725-ac054867fb82]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa606f-8dcc-427f-ab47-13ebadb3c121]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9c559-736a-4b61-ad70-6e3d532a3b3d]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230e694-a679-4caf-9d58-35debedbec9b]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc00d5-a89c-45fd-9605-8208c421cc4a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8398aeba-dcdd-49ec-a1ea-aa5d3e69069e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] Nov 30 06:33:57 user nova-compute[75021]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful. Nov 30 06:33:57 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65561c9-2ac3-4abf-9bf4-d65ce26c14e5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== disconnect_volume: return (391ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:33:58 user nova-compute[75021]: WARNING nova.compute.manager [req-98d0658e-128c-4e41-a426-5fe481889e89 req-64ef3948-b585-4929-b356-31713885f18c service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state active and task_state rebuilding. Nov 30 06:33:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:33:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.221839904785156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:33:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance destroyed successfully. Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-247650384',display_name='tempest-ServerActionsTestOtherA-server-1603071707',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-247650384',id=14,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFChRM0w/i91cbkgMIMcthhn+p2CU1fJz4Xb8hxlpy4nFA3oX5zbks8t7f/tS7KHuaxAgBYPifiwvu7dlOgqRlGddtoQoP2dwkBJ93a9ul51qiUUQ8M/T6VYXGAm+mXbg==',key_name='tempest-keypair-1106661472',keypairs=,launch_index=0,launched_at=2023-11-30T06:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-ea0wi5sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=c811878a-676f-43ed-ba7f-2b765a3c51bb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc85c214d-55, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c78a33b3-f9f2-4281-9c68-5f61e280c724) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:33:58 user nova-compute[75021]: INFO os_vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45262ed8-3908-41f4-9f95-d589518b0add]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:33:58 user nova-compute[75021]: No targets found. Nov 30 06:33:58 user nova-compute[75021]: iSNS: Nov 30 06:33:58 user nova-compute[75021]: No targets found. Nov 30 06:33:58 user nova-compute[75021]: STATIC: Nov 30 06:33:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:33:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:58 user nova-compute[75021]: Iface Name: default Nov 30 06:33:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:33:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:58 user nova-compute[75021]: Iface Name: default Nov 30 06:33:58 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:33:58 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:33:58 user nova-compute[75021]: Iface Name: default Nov 30 06:33:58 user nova-compute[75021]: FIRMWARE: Nov 30 06:33:58 user nova-compute[75021]: No targets found. Nov 30 06:33:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:33:58 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:33:58 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05347acc-d5d3-42df-81ef-64c3ddaf4834]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8822ec6b-8334-4c95-b5c6-b97d4321d765]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:58 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:58 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:33:58 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:33:58 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:33:58 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Resulting device map defaultdict(. at 0x7f000012beb0>, {}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Disconnecting from: [] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== disconnect_volume: return (101ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:33:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Deleting instance files /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb_del Nov 30 06:33:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Deletion of /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb_del complete Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 93976999-56e9-46f0-bf87-ef5b794f7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance f7b6383f-a916-400f-8424-54fbbffec7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c811878a-676f-43ed-ba7f-2b765a3c51bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 6db4aa82-04c5-4553-b3c4-64ce905085be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 906a06e5-395d-4a0f-a56c-58b53a0f59f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing inventories for resource provider c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Updating ProviderTree inventory for provider c24a175c-4584-420f-87fd-9adb114da12c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Updating inventory in ProviderTree for provider c24a175c-4584-420f-87fd-9adb114da12c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing aggregate associations for resource provider c24a175c-4584-420f-87fd-9adb114da12c, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} Nov 30 06:33:58 user nova-compute[75021]: INFO nova.virt.block_device [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Booting with volume 293fb4cb-a717-4862-ac5f-4815aa33d798 at /dev/vdb Nov 30 06:33:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Refreshing trait associations for resource provider c24a175c-4584-420f-87fd-9adb114da12c, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.utils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04258a-b596-4d82-b295-7a7ecff4b181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d94905-7670-4291-91a3-7ffb4adc5749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[496eff29-9736-4497-a3bb-7f5d93a9e88c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae6c62-7b99-484c-9114-51b036660256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:33:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:33:59 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:33:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7979abb-5fe0-4a93-b626-34e45cf9fe5e]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG os_brick.utils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Updating existing volume attachment record: 663451fb-b958-4f40-8b8a-402fe4dfe992 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:33:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Cleaning up deleted instances with incomplete migration {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquired lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [{"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Releasing lock "refresh_cache-e34d6b99-e3c6-4015-8e80-4d240a1301f3" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}} Nov 30 06:34:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Starting finish_revert_migration {{(pid=75021) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Start _get_guest_xml network_info=[{"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8e38220a-0fa9-4c33-a344-c421d3bfb638', 'attached_at': '2023-11-30T06:34:05.000000', 'detached_at': '', 'volume_id': 'f2b81199-b73a-4692-b455-3ea73065803c', 'serial': 'f2b81199-b73a-4692-b455-3ea73065803c'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b8f693cf-3374-4b01-8fae-11aedee58f04', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:34:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:34:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:05 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3de0d3-d776-4f01-8f20-0939cab74a1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:34:05 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1854c270-3228-4782-962a-8e7a21268aac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c] added Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e1d166-0abe-46bc-8894-ac4f94ecd370]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b007d3b-1acf-4d40-8ebd-387487d66212]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRiMurZE" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce12ec9-23d0-439c-8715-f87a444053b1]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRiMurZE'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d860a30-8834-4c48-b7d5-3efe546a1de5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662da47-c9cf-4f68-862c-d701c5cca450]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[70888729-74ea-4104-9578-df68c9e2c44b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] Nov 30 06:34:05 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c, portal: 172.16.0.220,3260] successful. Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee836820-2acc-41b5-ae23-666cb9c04072]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa7bdc-ef0f-44db-9479-50ce1f137dd7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:05 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:05 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b780b6-4a8e-47c7-a78c-ca9b883ac37d]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:34:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRiMurZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313161646430', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] End _get_guest_xml xml= Nov 30 06:34:06 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:34:06 user nova-compute[75021]: instance-00000003 Nov 30 06:34:06 user nova-compute[75021]: 524288 Nov 30 06:34:06 user nova-compute[75021]: 1 Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: tempest-ServerActionsTestOtherB-server-814384843 Nov 30 06:34:06 user nova-compute[75021]: 2023-11-30 06:34:05 Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: 512 Nov 30 06:34:06 user nova-compute[75021]: 1 Nov 30 06:34:06 user nova-compute[75021]: 0 Nov 30 06:34:06 user nova-compute[75021]: 0 Nov 30 06:34:06 user nova-compute[75021]: 1 Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113-project-member Nov 30 06:34:06 user nova-compute[75021]: tempest-ServerActionsTestOtherB-119119113 Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: OpenStack Foundation Nov 30 06:34:06 user nova-compute[75021]: OpenStack Nova Nov 30 06:34:06 user nova-compute[75021]: 0.0.0 Nov 30 06:34:06 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:34:06 user nova-compute[75021]: 8e38220a-0fa9-4c33-a344-c421d3bfb638 Nov 30 06:34:06 user nova-compute[75021]: Virtual Machine Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: hvm Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nehalem Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: /dev/urandom Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: Nov 30 06:34:06 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-814384843',display_name='tempest-ServerActionsTestOtherB-server-814384843',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-814384843',id=3,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAsCoWtr2vOeTzg5XtkTbBhETxphKF9OHR3gbvRUYV+KD5HNaIozCXPaFlhycC8NUdXX2uHl26VdFCf2Nntdr17x7SwH7aUqnsXhkhyTVpCbfG8thSn00bU8IJfbztMqQ==',key_name='tempest-keypair-1532382426',keypairs=,launch_index=0,launched_at=2023-11-30T06:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3936fa50a9544fcb9aaf6f46d45eda7f',ramdisk_id='',reservation_id='r-is5mfi1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-119119113',owner_user_name='tempest-ServerActionsTestOtherB-119119113-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc2e83db92a4551a7aabdf1111ecdc5',uuid=8e38220a-0fa9-4c33-a344-c421d3bfb638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converting VIF {"id": "6588b659-358d-40ed-9176-a98946d4cc7c", "address": "fa:16:3e:82:c8:d0", "network": {"id": "8235aec3-3ccf-4ee0-bf3c-c5412e29417d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-39192172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3936fa50a9544fcb9aaf6f46d45eda7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6588b659-35", "ovs_interfaceid": "6588b659-358d-40ed-9176-a98946d4cc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG os_vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3cf38a-7f55-5208-ac42-9fc77b9d2c74', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6588b659-35, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6588b659-35, col_values=(('qos', UUID('f250afb4-c437-423d-9af3-cf66a726f0d0')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6588b659-35, col_values=(('external_ids', {'iface-id': '6588b659-358d-40ed-9176-a98946d4cc7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c8:d0', 'vm-uuid': '8e38220a-0fa9-4c33-a344-c421d3bfb638'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: INFO os_vif [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d0,bridge_name='br-int',has_traffic_filtering=True,id=6588b659-358d-40ed-9176-a98946d4cc7c,network=Network(8235aec3-3ccf-4ee0-bf3c-c5412e29417d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6588b659-35') Nov 30 06:34:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:06 user nova-compute[75021]: INFO nova.compute.manager [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Terminating instance Nov 30 06:34:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-unplugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] No waiting events found dispatching network-vif-unplugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-4e887e1d-62a0-4b9a-8080-a6ffe7ee098b req-8c6329da-aa9c-44a4-86cd-057d97ec80b6 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-unplugged-5a09b55c-24da-4b37-9566-3a40a2f25619 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:34:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Creating image(s) Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "/opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk 1073741824" returned: 0 in 0.064s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.240s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Instance destroyed successfully. Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lazy-loading 'resources' on Instance uuid e34d6b99-e3c6-4015-8e80-4d240a1301f3 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.233s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-534843965',display_name='tempest-TestVolumeSwap-server-534843965',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-534843965',id=6,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4ttP/cOL+3Q4vYSrFHZnfUQ+SnxRJ8yeZNZ04+NQsUCi92Qw4yZtXeojA2RPApBkog4MwCtvrdB1HD5ie5ZialUg4lOTkgIIZh1s48nRZj+ZBZwjJYGTgN5TfesegAhg==',key_name='tempest-keypair-222683311',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c597d5b6050c481792ed86915f2a32c2',ramdisk_id='',reservation_id='r-4woyc6om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1764509351',owner_user_name='tempest-TestVolumeSwap-1764509351-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11527b4789a0455bb1221ad3260c5840',uuid=e34d6b99-e3c6-4015-8e80-4d240a1301f3,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converting VIF {"id": "5a09b55c-24da-4b37-9566-3a40a2f25619", "address": "fa:16:3e:73:8c:3f", "network": {"id": "ed7cec97-b3f0-4226-a5cf-0a1bb082c704", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254296922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c597d5b6050c481792ed86915f2a32c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a09b55c-24", "ovs_interfaceid": "5a09b55c-24da-4b37-9566-3a40a2f25619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_vif [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a09b55c-24, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32f7d576-25df-4342-a208-8422ca9a95f6) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:08 user nova-compute[75021]: INFO os_vif [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:3f,bridge_name='br-int',has_traffic_filtering=True,id=5a09b55c-24da-4b37-9566-3a40a2f25619,network=Network(ed7cec97-b3f0-4226-a5cf-0a1bb082c704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a09b55c-24') Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFcgKWuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'f14d0071-45aa-4be2-b6f5-a7fa9cd108d6'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:08 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e2d0b2-1e15-42b8-99bb-6c4d7e1f5dd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:34:08 user nova-compute[75021]: No targets found. Nov 30 06:34:08 user nova-compute[75021]: iSNS: Nov 30 06:34:08 user nova-compute[75021]: No targets found. Nov 30 06:34:08 user nova-compute[75021]: STATIC: Nov 30 06:34:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 Nov 30 06:34:08 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:08 user nova-compute[75021]: Iface Name: default Nov 30 06:34:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:34:08 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:08 user nova-compute[75021]: Iface Name: default Nov 30 06:34:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:34:08 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:08 user nova-compute[75021]: Iface Name: default Nov 30 06:34:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:34:08 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:08 user nova-compute[75021]: Iface Name: default Nov 30 06:34:08 user nova-compute[75021]: FIRMWARE: Nov 30 06:34:08 user nova-compute[75021]: No targets found. Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:34:08 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:34:08 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679dc7c-8770-4afa-b809-efaed41f1daa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Cannot resize image /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Start _get_guest_xml network_info=[{"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'image_id': '810aca46-134d-4ee2-b71a-3a2467a4bcb8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c811878a-676f-43ed-ba7f-2b765a3c51bb', 'attached_at': '', 'detached_at': '', 'volume_id': '293fb4cb-a717-4862-ac5f-4815aa33d798', 'serial': '293fb4cb-a717-4862-ac5f-4815aa33d798'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '663451fb-b958-4f40-8b8a-402fe4dfe992', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c176b-96f5-4862-a3f6-e6d8e2216337]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Resulting device map defaultdict(. at 0x7f0000255ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6'): ({'sdi'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Removing single pathed devices sdi {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Nov 30 06:34:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T06:24:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T06:24:14Z,direct_url=,disk_format='qcow2',id=810aca46-134d-4ee2-b71a-3a2467a4bcb8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='90d52b05ef474a9692b8f68b37161d0e',properties=ImageMetaProps,protected=,size=21430272,status='active',tags=,updated_at=2023-11-30T06:24:16Z,virtual_size=,visibility=), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lazy-loading 'vcpu_model' on Instance uuid c811878a-676f-43ed-ba7f-2b765a3c51bb {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1ec08-1a5e-4806-bbe2-0bb557389226]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:08 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf75125-de74-45bb-9d9f-3c0d9b744e72]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Flushing IO for device /dev/sdi {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:08 user nova-compute[75021]: WARNING nova.compute.manager [req-e7b705be-d0c3-421a-ab85-7b2cd7a819c1 req-d2e1e31f-a890-4463-aeda-091e4c5f2338 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state resized and task_state resize_reverting. Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c46633-45a5-49c5-8526-0e44f87c09ce]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecedc4e-74b8-4504-b1c4-ba967f923881]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] SCSI volumes sdi have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf5103c-e821-46ab-86f1-0deb2c2f7675]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f8136-dbab-4f25-92e1-471aea5455f2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] Nov 30 06:34:08 user nova-compute[75021]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6, portal: 172.16.0.220,3260] successful. Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14d0071-45aa-4be2-b6f5-a7fa9cd108d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a68a943-8142-4881-ab52-617e1e560b82]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] <== disconnect_volume: return (423ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:34:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Deleting instance files /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3_del Nov 30 06:34:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Deletion of /opt/stack/data/nova/instances/e34d6b99-e3c6-4015-8e80-4d240a1301f3_del complete Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.221s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:08 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:08 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae25b89-6c01-4d32-af7e-fa2d2266d1d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:34:08 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c31944-8142-4d65-a537-78f452587964]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798] added Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[02625f91-2478-4b3a-99df-cbeba1220db0]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: INFO nova.compute.manager [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Took 2.08 seconds to destroy the instance on the hypervisor. Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c3e22f-a1ec-4de6-8d2c-c8cdea9d0fea]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MklrqNKs {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MklrqNKs" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8c90b-33ac-4e03-841d-905e82175988]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MklrqNKs'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7a6ff1-38a1-41ab-ab92-f1df60784ffc]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a194668-45fe-4910-b273-372c8d1c1742]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:08 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:08 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b6f07-3dde-4531-9790-40a9ab374007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] Nov 30 06:34:09 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798, portal: 172.16.0.220,3260] successful. Nov 30 06:34:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e0978-c2b1-4187-ad10-18065e2268e5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[89778113-3166-404b-a353-986880539b28]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:09 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:09 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a798d9-995d-4599-938c-d98a715750d5]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MklrqNKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] Acquiring lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] No waiting events found dispatching network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:09 user nova-compute[75021]: WARNING nova.compute.manager [req-2fd5ecdc-2ea9-457b-a85e-81a02ee0105e req-e3313dff-a198-4e1f-aa11-9c040ca6a5b0 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received unexpected event network-vif-plugged-5a09b55c-24da-4b37-9566-3a40a2f25619 for instance with vm_state active and task_state deleting. Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 is timed out. Nov 30 06:34:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Successfully detached device vdb from instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 from the live domain config. Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOGVuvRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:09 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Took 0.77 seconds to deallocate network for instance. Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc7dc8a1-dd8f-438b-bda1-7d9cca2d45e0 req-5037b3b3-5c5d-485b-82c3-3b4526704df4 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Received event network-vif-deleted-5a09b55c-24da-4b37-9566-3a40a2f25619 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:09 user nova-compute[75021]: INFO nova.compute.manager [req-cc7dc8a1-dd8f-438b-bda1-7d9cca2d45e0 req-5037b3b3-5c5d-485b-82c3-3b4526704df4 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Neutron deleted interface 5a09b55c-24da-4b37-9566-3a40a2f25619; detaching it from the instance and deleting it from the info cache Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-cc7dc8a1-dd8f-438b-bda1-7d9cca2d45e0 req-5037b3b3-5c5d-485b-82c3-3b4526704df4 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-cc7dc8a1-dd8f-438b-bda1-7d9cca2d45e0 req-5037b3b3-5c5d-485b-82c3-3b4526704df4 service nova] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Detach interface failed, port_id=5a09b55c-24da-4b37-9566-3a40a2f25619, reason: Instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] <== connect_volume: return (1598ms) {'type': 'block', 'scsi_wwn': '23736376364393463', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736376364393463', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.514s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80516fa1-9a97-400e-a99a-d597796f5adb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:34:10 user nova-compute[75021]: No targets found. Nov 30 06:34:10 user nova-compute[75021]: iSNS: Nov 30 06:34:10 user nova-compute[75021]: No targets found. Nov 30 06:34:10 user nova-compute[75021]: STATIC: Nov 30 06:34:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:34:10 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:10 user nova-compute[75021]: Iface Name: default Nov 30 06:34:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:34:10 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:10 user nova-compute[75021]: Iface Name: default Nov 30 06:34:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:34:10 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:10 user nova-compute[75021]: Iface Name: default Nov 30 06:34:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 Nov 30 06:34:10 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:10 user nova-compute[75021]: Iface Name: default Nov 30 06:34:10 user nova-compute[75021]: FIRMWARE: Nov 30 06:34:10 user nova-compute[75021]: No targets found. Nov 30 06:34:10 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:34:10 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:34:10 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T06:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-247650384',display_name='tempest-ServerActionsTestOtherA-server-1603071707',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-247650384',id=14,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFChRM0w/i91cbkgMIMcthhn+p2CU1fJz4Xb8hxlpy4nFA3oX5zbks8t7f/tS7KHuaxAgBYPifiwvu7dlOgqRlGddtoQoP2dwkBJ93a9ul51qiUUQ8M/T6VYXGAm+mXbg==',key_name='tempest-keypair-1106661472',keypairs=,launch_index=0,launched_at=2023-11-30T06:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-ea0wi5sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=c811878a-676f-43ed-ba7f-2b765a3c51bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] End _get_guest_xml xml= Nov 30 06:34:10 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:34:10 user nova-compute[75021]: instance-0000000e Nov 30 06:34:10 user nova-compute[75021]: 524288 Nov 30 06:34:10 user nova-compute[75021]: 1 Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: tempest-ServerActionsTestOtherA-server-1603071707 Nov 30 06:34:10 user nova-compute[75021]: 2023-11-30 06:34:08 Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: 512 Nov 30 06:34:10 user nova-compute[75021]: 1 Nov 30 06:34:10 user nova-compute[75021]: 0 Nov 30 06:34:10 user nova-compute[75021]: 0 Nov 30 06:34:10 user nova-compute[75021]: 1 Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321-project-member Nov 30 06:34:10 user nova-compute[75021]: tempest-ServerActionsTestOtherA-1719918321 Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: OpenStack Foundation Nov 30 06:34:10 user nova-compute[75021]: OpenStack Nova Nov 30 06:34:10 user nova-compute[75021]: 0.0.0 Nov 30 06:34:10 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:34:10 user nova-compute[75021]: c811878a-676f-43ed-ba7f-2b765a3c51bb Nov 30 06:34:10 user nova-compute[75021]: Virtual Machine Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: hvm Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nehalem Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: 293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: /dev/urandom Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: Nov 30 06:34:10 user nova-compute[75021]: {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T06:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-247650384',display_name='tempest-ServerActionsTestOtherA-server-1603071707',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-247650384',id=14,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFChRM0w/i91cbkgMIMcthhn+p2CU1fJz4Xb8hxlpy4nFA3oX5zbks8t7f/tS7KHuaxAgBYPifiwvu7dlOgqRlGddtoQoP2dwkBJ93a9ul51qiUUQ8M/T6VYXGAm+mXbg==',key_name='tempest-keypair-1106661472',keypairs=,launch_index=0,launched_at=2023-11-30T06:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='de15912e470d4bc0b9ab9f3fb6142c5e',ramdisk_id='',reservation_id='r-ea0wi5sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1719918321',owner_user_name='tempest-ServerActionsTestOtherA-1719918321-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T06:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0200b58bd1534bc28872adc5cf426ad2',uuid=c811878a-676f-43ed-ba7f-2b765a3c51bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converting VIF {"id": "c85c214d-5540-4ee9-98d8-e6c216dab155", "address": "fa:16:3e:5d:61:94", "network": {"id": "923eb320-bd94-4e75-9c81-b7e013ee85de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-465115872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de15912e470d4bc0b9ab9f3fb6142c5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85c214d-55", "ovs_interfaceid": "c85c214d-5540-4ee9-98d8-e6c216dab155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d296419-3c9b-504c-9e42-b17711439bea', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f46af-ca10-413c-ab3e-d9c45c6471fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc85c214d-55, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc85c214d-55, col_values=(('qos', UUID('6220196b-475b-4409-8142-839100e5c508')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc85c214d-55, col_values=(('external_ids', {'iface-id': 'c85c214d-5540-4ee9-98d8-e6c216dab155', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:61:94', 'vm-uuid': 'c811878a-676f-43ed-ba7f-2b765a3c51bb'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: INFO os_vif [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:61:94,bridge_name='br-int',has_traffic_filtering=True,id=c85c214d-5540-4ee9-98d8-e6c216dab155,network=Network(923eb320-bd94-4e75-9c81-b7e013ee85de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85c214d-55') Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eef38b-ec60-4002-8fdf-d6ae70eeabcd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:10 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:10 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:10 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Resulting device map defaultdict(. at 0x7f0000232680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e085ed-7390-4e52-b978-fc81e720bea9]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5381ac5-bf79-4ec7-acb5-e699019fba8c]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] No VIF found with MAC fa:16:3e:5d:61:94, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ac6e9-6037-4f79-8627-4d98ed270cfb]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bbf37a-b32b-4f87-a081-1819ebd3d8e3]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce4c86-2374-4c7e-b7cf-56b7ce094eca]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3f8c0-e6b6-4006-9d76-c136d75fd590]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] Nov 30 06:34:10 user nova-compute[75021]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40, portal: 172.16.0.220,3260] successful. Nov 30 06:34:10 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482c363d-cfed-4540-bfe6-65d877a34c40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f72f1-3560-48cf-9ceb-ad3d1cd1f7c5]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] <== disconnect_volume: return (864ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:34:10 user nova-compute[75021]: INFO nova.compute.manager [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] [instance: e34d6b99-e3c6-4015-8e80-4d240a1301f3] Took 0.94 seconds to detach 1 volumes for instance. Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] No waiting events found dispatching network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:10 user nova-compute[75021]: WARNING nova.compute.manager [req-db7e905a-9788-4039-b30f-cfc3e4c8a3c7 req-c17754b3-a9a5-4f66-8cd2-f46e378861e0 service nova] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Received unexpected event network-vif-plugged-6588b659-358d-40ed-9176-a98946d4cc7c for instance with vm_state resized and task_state resize_reverting. Nov 30 06:34:10 user nova-compute[75021]: INFO nova.compute.manager [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Terminating instance Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:34:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Instance running successfully. Nov 30 06:34:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] finish_revert_migration finished successfully. {{(pid=75021) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:10 user nova-compute[75021]: INFO nova.compute.manager [None req-7c08834d-812a-4d3e-8650-76ab1b96ec29 tempest-ServerActionsTestOtherB-119119113 tempest-ServerActionsTestOtherB-119119113-project-member] [instance: 8e38220a-0fa9-4c33-a344-c421d3bfb638] Updating instance to original state: 'active' Nov 30 06:34:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:11 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Deleted allocations for instance e34d6b99-e3c6-4015-8e80-4d240a1301f3 Nov 30 06:34:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-87cf6bf1-cbcb-4e2f-8ff9-44b9d2cfbdc2 tempest-TestVolumeSwap-1764509351 tempest-TestVolumeSwap-1764509351-project-member] Lock "e34d6b99-e3c6-4015-8e80-4d240a1301f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 4.714s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-unplugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] No waiting events found dispatching network-vif-unplugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-unplugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Acquiring lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] No waiting events found dispatching network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:11 user nova-compute[75021]: WARNING nova.compute.manager [req-cdee96a3-301c-4d16-aad7-42f8448e7989 req-2e0ab761-839f-4475-a1f9-6017cdfbb248 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received unexpected event network-vif-plugged-9c696cbf-a571-4dc0-8706-f6226b0a28b8 for instance with vm_state active and task_state deleting. Nov 30 06:34:11 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8508b50c-0458-41f9-90ef-1f217d88d5ba tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.869s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Instance destroyed successfully. Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lazy-loading 'resources' on Instance uuid 93976999-56e9-46f0-bf87-ef5b794f7a38 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2079750467',display_name='tempest-VolumesAdminNegativeTest-server-2079750467',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2079750467',id=5,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYFjh/C6H20O+Vry84XGMyzhsk57im2TYFFdrdP71AZg4WcBLbrppu5iHDLegBB87iFdHLDLxMiqNWAH6CBnZ9RKKYzYQKp1Fiw4tkbT1jbIENtRd4XsV3VxMKyy7k47g==',key_name='tempest-keypair-1392797650',keypairs=,launch_index=0,launched_at=2023-11-30T06:28:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4030319f0557410c860f416b508c2883',ramdisk_id='',reservation_id='r-7dojkdgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-197033440',owner_user_name='tempest-VolumesAdminNegativeTest-197033440-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03c0fb72598413b81c9da1d6e8b32e9',uuid=93976999-56e9-46f0-bf87-ef5b794f7a38,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converting VIF {"id": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "address": "fa:16:3e:04:f7:4b", "network": {"id": "017f7023-8b2d-4cf2-96d8-8f7ec3b44b86", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1710315439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4030319f0557410c860f416b508c2883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c696cbf-a5", "ovs_interfaceid": "9c696cbf-a571-4dc0-8706-f6226b0a28b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG os_vif [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c696cbf-a5, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ea035ee-0192-455a-b72e-c7bd739ddb10) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:12 user nova-compute[75021]: INFO os_vif [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:4b,bridge_name='br-int',has_traffic_filtering=True,id=9c696cbf-a571-4dc0-8706-f6226b0a28b8,network=Network(017f7023-8b2d-4cf2-96d8-8f7ec3b44b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c696cbf-a5') Nov 30 06:34:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Deleting instance files /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38_del Nov 30 06:34:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Deletion of /opt/stack/data/nova/instances/93976999-56e9-46f0-bf87-ef5b794f7a38_del complete Nov 30 06:34:12 user nova-compute[75021]: INFO nova.compute.manager [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Took 1.59 seconds to destroy the instance on the hypervisor. Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:12 user nova-compute[75021]: WARNING nova.compute.manager [req-87719fa9-d13d-4669-8539-c16dc3e2a617 req-2528de46-3c10-44fe-910f-f31ebed1e828 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state active and task_state rebuild_spawning. Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75021) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}} Nov 30 06:34:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lazy-loading 'flavor' on Instance uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:13 user nova-compute[75021]: WARNING nova.compute.manager [req-f2f49ba2-6b95-4b64-99a9-d7b3e74032e4 req-9947b56c-ee6c-44b6-a4c8-5af88d2a7da5 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-unplugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state active and task_state powering-off. Nov 30 06:34:13 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Took 1.35 seconds to deallocate network for instance. Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Instance destroyed successfully. Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-4f17a9c5-5991-4c77-b76a-0f1d0ec4ab77 req-1e6ec3ef-a6c7-425b-80ab-db9d3a78e423 service nova] [instance: 93976999-56e9-46f0-bf87-ef5b794f7a38] Received event network-vif-deleted-9c696cbf-a571-4dc0-8706-f6226b0a28b8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e19623e9-164e-4a95-b626-a4f21df081a2 tempest-AttachVolumeTestJSON-1859687396 tempest-AttachVolumeTestJSON-1859687396-project-member] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: held 0.943s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:13 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:14 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Deleted allocations for instance 93976999-56e9-46f0-bf87-ef5b794f7a38 Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-556811d9-8fc4-484f-beec-b6f8b5902cca tempest-VolumesAdminNegativeTest-197033440 tempest-VolumesAdminNegativeTest-197033440-project-member] Lock "93976999-56e9-46f0-bf87-ef5b794f7a38" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 3.538s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] No waiting events found dispatching network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:14 user nova-compute[75021]: WARNING nova.compute.manager [req-86eedb91-5f8b-4f1a-8fe2-33253b2e678b req-f41710e8-9dce-4cf6-bbcb-b68cbec88105 service nova] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Received unexpected event network-vif-plugged-c85c214d-5540-4ee9-98d8-e6c216dab155 for instance with vm_state active and task_state rebuild_spawning. Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance event wait completed in 0 seconds for {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}} Nov 30 06:34:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Instance spawned successfully. Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] [instance: c811878a-676f-43ed-ba7f-2b765a3c51bb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75021) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}} Nov 30 06:34:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9624fe83-c1d6-42a3-8675-44d68fb1b87b tempest-ServerActionsTestOtherA-1719918321 tempest-ServerActionsTestOtherA-1719918321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] No waiting events found dispatching network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:15 user nova-compute[75021]: WARNING nova.compute.manager [req-1eac4b0a-c89c-4b60-b07f-d62f07e24b47 req-5000e1de-c223-4abd-bf53-e8fdea357869 service nova] [instance: 9f0fa9f8-75a4-48ba-8096-49e7665a0511] Received unexpected event network-vif-plugged-1bb1058b-c894-4e0a-90f0-e55b835b8679 for instance with vm_state stopped and task_state None. Nov 30 06:34:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f7b6383f-a916-400f-8424-54fbbffec7b8 is timed out. Nov 30 06:34:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully detached device vdb from instance f7b6383f-a916-400f-8424-54fbbffec7b8 from the live domain config. Nov 30 06:34:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHPqEZfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[03586fd5-6109-4604-af16-78567e69a724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Nov 30 06:34:17 user nova-compute[75021]: No targets found. Nov 30 06:34:17 user nova-compute[75021]: iSNS: Nov 30 06:34:17 user nova-compute[75021]: No targets found. Nov 30 06:34:17 user nova-compute[75021]: STATIC: Nov 30 06:34:17 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c Nov 30 06:34:17 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:17 user nova-compute[75021]: Iface Name: default Nov 30 06:34:17 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 Nov 30 06:34:17 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:17 user nova-compute[75021]: Iface Name: default Nov 30 06:34:17 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb Nov 30 06:34:17 user nova-compute[75021]: Portal: 172.16.0.220:3260,-1 Nov 30 06:34:17 user nova-compute[75021]: Iface Name: default Nov 30 06:34:17 user nova-compute[75021]: FIRMWARE: Nov 30 06:34:17 user nova-compute[75021]: No targets found. Nov 30 06:34:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Nov 30 06:34:17 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Nov 30 06:34:17 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2001e-e949-4234-9796-111e1985a3b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909e3af-ce84-4004-a055-5a4219ec3401]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:17 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:17 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb (non-flash) Nov 30 06:34:17 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:17 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Resulting device map defaultdict(. at 0x7f00003ce3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb'): ({'sdg'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Removing single pathed devices sdg {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3e983-af23-4f6d-808f-64ada3d7780f]: (4, ('path checker states:\nup 3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c3e378-76f6-4375-82ef-58eb4e7bb598]: (4, ('ok\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Flushing IO for device /dev/sdg {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399a81e-4f4e-47b9-b9a6-e2848db03e7a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8ae6d-e90d-413f-9a85-dff3b81ab6a0]: (4, ('1', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[635b88b9-2678-450b-ba2d-0519e3e08d00]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --logout {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c358f-7a9c-49f5-b842-04c67f1107b6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] Nov 30 06:34:17 user nova-compute[75021]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb, portal: 172.16.0.220,3260] successful. Nov 30 06:34:17 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op delete {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e838b0aa-5009-435c-8102-b183d1e631cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e5ca0-b191-4362-b18e-888a8499df25]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] <== disconnect_volume: return (330ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}} Nov 30 06:34:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'flavor' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bbd0251b-d8fc-47a2-b72b-aa08ba3efbc0 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 22.164s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid 9f0fa9f8-75a4-48ba-8096-49e7665a0511 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid 8e38220a-0fa9-4c33-a344-c421d3bfb638 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid 63ed94e2-f3c4-48ca-8c90-29ddf619e309 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid b23fb096-817f-4e68-a725-91a7492c5f48 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid 6db4aa82-04c5-4553-b3c4-64ce905085be {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid 906a06e5-395d-4a0f-a56c-58b53a0f59f2 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Triggering sync for uuid c811878a-676f-43ed-ba7f-2b765a3c51bb {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "b23fb096-817f-4e68-a725-91a7492c5f48" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "63ed94e2-f3c4-48ca-8c90-29ddf619e309" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.075s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "9f0fa9f8-75a4-48ba-8096-49e7665a0511" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.083s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.078s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "8e38220a-0fa9-4c33-a344-c421d3bfb638" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.096s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "b23fb096-817f-4e68-a725-91a7492c5f48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.096s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.096s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.104s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "c811878a-676f-43ed-ba7f-2b765a3c51bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.104s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Received event network-changed-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Refreshing instance network info cache due to event network-changed-c2dc1b6a-28a3-4073-89e4-4323f7bbe40a. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] Acquiring lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] Acquired lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:34:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Refreshing network info cache for port c2dc1b6a-28a3-4073-89e4-4323f7bbe40a {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updated VIF entry in instance network info cache for port c2dc1b6a-28a3-4073-89e4-4323f7bbe40a. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updating instance_info_cache with network_info: [{"id": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "address": "fa:16:3e:ab:61:d4", "network": {"id": "cb662fc9-d454-403a-b88a-095e4b6efc84", "bridge": "br-int", "label": "tempest-TestStampPattern-1962765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ae80ead9b4608b5ecf5054d70865e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2dc1b6a-28", "ovs_interfaceid": "c2dc1b6a-28a3-4073-89e4-4323f7bbe40a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbfe777d-3883-4c4c-af35-810e00ad9912 req-6d91b233-e27d-4447-814a-e666227bd4b1 service nova] Releasing lock "refresh_cache-6db4aa82-04c5-4553-b3c4-64ce905085be" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG nova.objects.instance [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'flavor' on Instance uuid 6db4aa82-04c5-4553-b3c4-64ce905085be {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.053s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:42 user nova-compute[75021]: INFO nova.compute.manager [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Attaching volume e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 to /dev/vdb Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.utils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e016b00-4dad-4c77-ba3f-025791cbb9d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49008d0-1432-49a4-85e9-2f2d962b571e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b61af48-2f38-4dc9-a70b-5fd1067b1238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[419bbdcd-4551-41d5-a4b1-7e6e451cbabe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:34:42 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:34:42 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7d136a-5fc3-4fe2-8ddc-572bee067776]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG os_brick.utils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:42 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Updating existing volume attachment record: 48b9dd50-c124-43e0-bd8f-29d6c134746a {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:34:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:47 user nova-compute[75021]: INFO nova.compute.manager [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Terminating instance Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-unplugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] No waiting events found dispatching network-vif-unplugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-68002f4a-5a53-444a-b06f-eeb15e379d0d req-941ad29b-67a2-4cd6-9fcd-65bd613c6458 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-unplugged-45cc5eb4-5588-4c0a-806a-979fee73c91b for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}} Nov 30 06:34:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Instance destroyed successfully. Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lazy-loading 'resources' on Instance uuid f7b6383f-a916-400f-8424-54fbbffec7b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-790651217',display_name='tempest-TestServerVolumeAttachmentScenario-server-790651217',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-790651217',id=11,image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMumuLd/vivD1dUT4NZ3fJmWAgCv/IlGJtVe87z04aGcHMeSGeaG8IkaY9YU+RrpMqdMTABjKRXAa0s5WiT/qI8RQFS0psprqrGwFxIGxHzguKNLQgL52LL4LUoOWtPexw==',key_name='tempest-keypair-1085533526',keypairs=,launch_index=0,launched_at=2023-11-30T06:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ab7adb9edd61405a8ea1c6ee7d5a1fe7',ramdisk_id='',reservation_id='r-vg0pci6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='810aca46-134d-4ee2-b71a-3a2467a4bcb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804702332',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804702332-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2023-11-30T06:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f020560ef24aacb4faeefaf513150c',uuid=f7b6383f-a916-400f-8424-54fbbffec7b8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converting VIF {"id": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "address": "fa:16:3e:26:6c:1a", "network": {"id": "a1f9417f-0478-4383-8b4d-9f0e3206051b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1292599819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7adb9edd61405a8ea1c6ee7d5a1fe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cc5eb4-55", "ovs_interfaceid": "45cc5eb4-5588-4c0a-806a-979fee73c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG os_vif [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45cc5eb4-55, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a25e646f-ad64-42f1-9666-4071755666a7) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:47 user nova-compute[75021]: INFO os_vif [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:6c:1a,bridge_name='br-int',has_traffic_filtering=True,id=45cc5eb4-5588-4c0a-806a-979fee73c91b,network=Network(a1f9417f-0478-4383-8b4d-9f0e3206051b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cc5eb4-55') Nov 30 06:34:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Deleting instance files /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8_del Nov 30 06:34:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Deletion of /opt/stack/data/nova/instances/f7b6383f-a916-400f-8424-54fbbffec7b8_del complete Nov 30 06:34:47 user nova-compute[75021]: INFO nova.compute.manager [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Took 0.91 seconds to destroy the instance on the hypervisor. Nov 30 06:34:47 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}} Nov 30 06:34:47 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] Acquiring lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] No waiting events found dispatching network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}} Nov 30 06:34:49 user nova-compute[75021]: WARNING nova.compute.manager [req-635a7b6a-ea3d-479c-9227-e9fb79931121 req-295e3c7b-7a7d-489e-8d54-82457b6785a3 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received unexpected event network-vif-plugged-45cc5eb4-5588-4c0a-806a-979fee73c91b for instance with vm_state active and task_state deleting. Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:49 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Took 1.64 seconds to deallocate network for instance. Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-de3ee042-fa70-4a5f-8f23-bebcfa560f90 req-c15d8b18-3c76-4ff1-a1eb-411ed7771d43 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Received event network-vif-deleted-45cc5eb4-5588-4c0a-806a-979fee73c91b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:49 user nova-compute[75021]: INFO nova.compute.manager [req-de3ee042-fa70-4a5f-8f23-bebcfa560f90 req-c15d8b18-3c76-4ff1-a1eb-411ed7771d43 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Neutron deleted interface 45cc5eb4-5588-4c0a-806a-979fee73c91b; detaching it from the instance and deleting it from the info cache Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-de3ee042-fa70-4a5f-8f23-bebcfa560f90 req-c15d8b18-3c76-4ff1-a1eb-411ed7771d43 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-de3ee042-fa70-4a5f-8f23-bebcfa560f90 req-c15d8b18-3c76-4ff1-a1eb-411ed7771d43 service nova] [instance: f7b6383f-a916-400f-8424-54fbbffec7b8] Detach interface failed, port_id=45cc5eb4-5588-4c0a-806a-979fee73c91b, reason: Instance f7b6383f-a916-400f-8424-54fbbffec7b8 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:34:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:50 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Deleted allocations for instance f7b6383f-a916-400f-8424-54fbbffec7b8 Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47adff55-b537-40af-9858-17ad355ec838 tempest-TestServerVolumeAttachmentScenario-1804702332 tempest-TestServerVolumeAttachmentScenario-1804702332-project-member] Lock "f7b6383f-a916-400f-8424-54fbbffec7b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 3.110s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geRwnpjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:50 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:50 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}} Nov 30 06:34:50 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260 Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d82818-ea5b-4c82-b523-f700007042ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Nov 30 06:34:50 user nova-compute[75021]: {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e7fb6-2aea-4463-bb04-41037702622f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06] added\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06] added Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b9346-9720-4b94-aa80-0092d402ac6c]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9595332-4dbb-46b4-91d4-7bcc436cc41a]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geRwnpjZ {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geRwnpjZ" returned: 0 in 0.021s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2c5890-379f-4f84-a564-ad650c1921e7]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geRwnpjZ'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67fd50-4858-4c8b-a6a4-4c4c91e814dc]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d5e05-8fed-4641-a3c2-9f0a9a090e58]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --login {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b271d585-29b8-4d38-ad11-c3cd08ee3ccc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06, portal: 172.16.0.220,3260] Nov 30 06:34:50 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06, portal: 172.16.0.220,3260] successful. Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14911c9a-6c13-449d-be98-c385c83ea85e]: (4, ('', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02d72b-64ae-4488-bcad-f9a6e81c4f72]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 (non-flash)\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b81199-b73a-4692-b455-3ea73065803c (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:293fb4cb-a717-4862-ac5f-4815aa33d798 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 (non-flash) Nov 30 06:34:50 user nova-compute[75021]: stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}} Nov 30 06:34:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dcbcc9-896e-40a9-aa77-16661a91a39c]: (4, ('- - 0', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e70bf2cb-2926-41e7-b4c8-a1c57ec23e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geRwnpjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Received event network-changed-276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Refreshing instance network info cache due to event network-changed-276d3842-23e2-4028-8bed-44014bb20232. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] Acquiring lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] Acquired lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 30 06:34:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Refreshing network info cache for port 276d3842-23e2-4028-8bed-44014bb20232 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23731653266306633', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731653266306633', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lazy-loading 'flavor' on Instance uuid 6db4aa82-04c5-4553-b3c4-64ce905085be {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] attach device xml: Nov 30 06:34:52 user nova-compute[75021]: Nov 30 06:34:52 user nova-compute[75021]: Nov 30 06:34:52 user nova-compute[75021]: Nov 30 06:34:52 user nova-compute[75021]: e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 Nov 30 06:34:52 user nova-compute[75021]: Nov 30 06:34:52 user nova-compute[75021]: {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updated VIF entry in instance network info cache for port 276d3842-23e2-4028-8bed-44014bb20232. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updating instance_info_cache with network_info: [{"id": "276d3842-23e2-4028-8bed-44014bb20232", "address": "fa:16:3e:eb:90:17", "network": {"id": "143ad363-94b3-4a4c-aef6-b388041512a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811969699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b161726bbb4145a583b93842478bece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d3842-23", "ovs_interfaceid": "276d3842-23e2-4028-8bed-44014bb20232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1ee67f1-498d-43bf-84a0-46897405cc19 req-de14acf6-4c1c-4778-921e-71181c066fe1 service nova] Releasing lock "refresh_cache-906a06e5-395d-4a0f-a56c-58b53a0f59f2" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] No VIF found with MAC fa:16:3e:ab:61:d4, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94375b31-d514-43dc-ab8e-7fb9c0b66ece tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lazy-loading 'flavor' on Instance uuid 906a06e5-395d-4a0f-a56c-58b53a0f59f2 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.050s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Acquiring lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Lock "906a06e5-395d-4a0f-a56c-58b53a0f59f2" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:53 user nova-compute[75021]: INFO nova.compute.manager [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Attaching volume 6214c1b3-a2fa-4c71-84c4-aeb3858a6f37 to /dev/sdc Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d2ce15-9462-45c7-8de2-b98142146f85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47c67020a744\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6c88e-a826-4314-8dc6-9e65f5b3358c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aeb4b5-7f2d-40e3-8a6a-01f93aaaf5ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbbfe90-ea1b-482e-8f18-1aa0753567f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}} Nov 30 06:34:53 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Nov 30 06:34:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb771b1-5849-417b-a4fd-26145ca8d93b]: (4, '') {{(pid=86220) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47c67020a744', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}} Nov 30 06:34:53 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9b779cd0-bf41-4b50-90d1-cf6c48e5f771 tempest-AttachSCSIVolumeTestJSON-779939869 tempest-AttachSCSIVolumeTestJSON-779939869-project-member] [instance: 906a06e5-395d-4a0f-a56c-58b53a0f59f2] Updating existing volume attachment record: 93060b60-e3c2-4061-af32-86e6d1190b91 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Acquiring lock "6db4aa82-04c5-4553-b3c4-64ce905085be" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Lock "6db4aa82-04c5-4553-b3c4-64ce905085be" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:54 user nova-compute[75021]: INFO nova.compute.manager [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Detaching volume e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 Nov 30 06:34:54 user nova-compute[75021]: INFO nova.virt.block_device [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] [instance: 6db4aa82-04c5-4553-b3c4-64ce905085be] Attempting to driver detach volume e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 from mountpoint /dev/vdb Nov 30 06:34:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Attempting to detach device vdb from instance 6db4aa82-04c5-4553-b3c4-64ce905085be from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] detach device xml: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 Nov 30 06:34:54 user nova-compute[75021]:
Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:34:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Successfully detached device vdb from instance 6db4aa82-04c5-4553-b3c4-64ce905085be from the persistent domain config. Nov 30 06:34:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6db4aa82-04c5-4553-b3c4-64ce905085be from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}} Nov 30 06:34:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] detach device xml: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: e70bf2cb-2926-41e7-b4c8-a1c57ec23e06 Nov 30 06:34:54 user nova-compute[75021]:
Nov 30 06:34:54 user nova-compute[75021]: Nov 30 06:34:54 user nova-compute[75021]: {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-115459b7-b100-4a1b-92d3-aca09f5a699d tempest-TestStampPattern-1491533737 tempest-TestStampPattern-1491533737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6db4aa82-04c5-4553-b3c4-64ce905085be {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906a06e5-395d-4a0f-a56c-58b53a0f59f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e38220a-0fa9-4c33-a344-c421d3bfb638/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0fa9f8-75a4-48ba-8096-49e7665a0511/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c811878a-676f-43ed-ba7f-2b765a3c51bb/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b23fb096-817f-4e68-a725-91a7492c5f48/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ed94e2-f3c4-48ca-8c90-29ddf619e309/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db4aa82-04c5-4553-b3c4-64ce905085be/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}} Nov 30 06:34:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:34:58 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Nov 30 06:34:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Hypervisor/Node resource view: name=user free_ram=7982MB free_disk=25.318653106689453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 9f0fa9f8-75a4-48ba-8096-49e7665a0511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 63ed94e2-f3c4-48ca-8c90-29ddf619e309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance b23fb096-817f-4e68-a725-91a7492c5f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance c811878a-676f-43ed-ba7f-2b765a3c51bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 8e38220a-0fa9-4c33-a344-c421d3bfb638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 6db4aa82-04c5-4553-b3c4-64ce905085be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Instance 906a06e5-395d-4a0f-a56c-58b53a0f59f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Acquiring lock "f4619d38-8d3f-44b2-a302-6ec971767bd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "f4619d38-8d3f-44b2-a302-6ec971767bd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:34:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}} Nov 30 06:35:00 user nova-compute[75021]: INFO nova.compute.claims [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Claim successful on node user Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Inventory has not changed in ProviderTree for provider: c24a175c-4584-420f-87fd-9adb114da12c {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Inventory has not changed for provider c24a175c-4584-420f-87fd-9adb114da12c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}} Nov 30 06:35:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.policy [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '412cfa23728649d087373994417197ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0d4e1bd3cb45069eb313658c4f2490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}} Nov 30 06:35:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Creating image(s) Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4619d38-8d3f-44b2-a302-6ec971767bd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "/opt/stack/data/nova/instances/f4619d38-8d3f-44b2-a302-6ec971767bd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "/opt/stack/data/nova/instances/f4619d38-8d3f-44b2-a302-6ec971767bd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:35:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Acquiring lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/f4619d38-8d3f-44b2-a302-6ec971767bd9/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b,backing_fmt=raw /opt/stack/data/nova/instances/f4619d38-8d3f-44b2-a302-6ec971767bd9/disk 1073741824" returned: 0 in 0.077s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Lock "636cc66b342cbfccdf0ffb20f6638cf61bc8428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/636cc66b342cbfccdf0ffb20f6638cf61bc8428b --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6d088194-5a49-4dc4-a8af-485b41c44478 tempest-ServerBootFromVolumeStableRescueTest-493345818 tempest-ServerBootFromVolumeStableRescueTest-493345818-project-member] [instance: f4619d38-8d3f-44b2-a302-6ec971767bd9] Successfully created port: 461e579a-0c22-4b26-946b-ae3d3150a0de {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Nov 30 06:35:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a7ee4379-1c1d-456a-9771-59cc1d114207 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}